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PATENT APPLICATION 
0100.0000300 

METHOD AND APPARATUS FOR PROCESSING NON-PLANAR VIDEO 
5 GRAPHICS PRIMITIVES 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The present application is related to the following co-pending, commonly 
assigned U.S. Patent Applications: 

U.S. Patent Application Serial No. 09/556,474, entitled "A Geometric Engine 
1 0 Including A Computational Module For Use In A Video Graphics Controller" and filed 
April 21, 2000; and 

U.S. Patent Application Serial No. , entitled "Apparatus 

for Processing Non-Planar Video Graphics Primitives and Associated Method of 
Operation" and filed on an even date herewith. 

1 5 FIELD OF THE INVENTION 

The invention relates generally to video graphics processing and more particularly 
to an apparatus for processing non-planar video graphics primitives and an associated 
method of operation. 

BACKGROUND OF THE INVENTION 

20 Video graphics systems typically use planar primitives, such as triangles, to 

represent three-dimensional objects. The three-dimensional (3D) pipeline that processes 
the triangular primitives rasterizes these planar primitives to produce pixel data that is 
blended with additional pixel data stored in a frame buffer. The results produced in the 
frame buffer are then fetched and a display signal is generated such that the three- 

25 dimensional objects are shown on the display. 

Some non-planar or curved surfaces or objects require a large number of planar 
video graphics primitives in order to be accurately represented. These curved surfaces 
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are broken into a large number of planar primitives that are then provided to the three- 
dimensional graphics processing pipeline for rendering. Typically, the separation of the 
curved surfaces into planar primitives is performed in software. This requires a large 
amount of processing resources on the part of the central processor within the system, hi 
addition, a large amount of data traffic results from the processor sending the vertex data 
corresponding to all of the planar triangles to the 3D pipeline for processing. 

Therefore, a need exists for a method and apparatus for processing non-planar 
video graphics data that offloads the central processor and reduces the bandwidth 
required to provide the primitive data from the central processor to the 3D pipeline. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a graphical representation of a non-planar video graphics 
primitive in accordance with a particular embodiment of the present invention. 

FIG. 2 illustrates a graphical representation of the video graphics primitive of 
FIG. 1 together with a number of control points associated with a cubic Bezier triangular 
control mesh in accordance with a particular embodiment of the present invention. 

FIGs. 3 and 4 illustrate a graphical representation of a first technique used to 
determine control points that relate to an edge of the non-planar video graphics primitive 
in accordance with a particular embodiment of the present invention. 

FIGs. 5 and 6 illustrate a graphical representation of a second technique used to 
determine control points that relate to an edge of the non-planar video graphics primitive 
in accordance with a particular embodiment of the present invention. 

FIG. 7 illustrates a graphical representation of the non-planar video graphics 
primitive and a technique for determining the central control point for the cubic Bezier 
triangular control mesh in accordance v^th a particular embodiment of the present 
invention. 



FIG. 8 illustrates a representation in barycentric coordinate space of the non- 
planar video graphics primitive and control points that make up a cubic Bezier triangular 
control mesh and a quadratic Bezier triangular control mesh determined in accordance 
v^ith a particular embodiment of the present invention. 

FIG. 9 illustrates a graphical representation of the use of barycentric coordinates 
for evaluating a Bernstein polynomial to derive the positions of vertices associated with 
tessellated primitives in accordance v^ith a particular embodiment of the present 
invention. 

FIG. 10 illustrates a subset of the planar tessellated primitives illustrated in FIG. 9 
and normals associated v^ith vertices of the subset of tessellated primitives as determined 
in accordance v^ith a particular embodiment of the present invention. 

FIG. 1 1 illustrates a graphical representation of a set of planar video graphics 
primitives resulting from level one tessellation of the non-planar video graphics primitive 
in accordance with a particular embodiment of the present invention. 

FIG. 12 illustrates the planar video graphics primitives resulting from tessellation 
of the video graphics primitive of FIG. 1 1 together with a set of planar video graphics 
primitives resulting from tessellation of a neighboring non-planar video graphics 
primitive in accordance with a particular embodiment of the present invention. 

FIG. 13 illustrates a block diagram of a video graphics processing system that 
includes a high-order primitive processing unit in accordance with a particular 
embodiment of the present invention. 

FIG. 14 illustrates a block diagram of a preferred high-order primitive processing 
unit for use in the video graphics processing system of FIG. 13. 

FIG. 15 illustrates a block diagram of a preferred computation engine and output 
data flow memory for use in the high-order primitive processing unit of FIG. 14. 



DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 

Generally, the present invention provides a method and apparatus for processing 
non-planar video graphics primitives. This is accomplished by receiving vertex 
parameters corresponding to vertices of a video graphics primitive, where the video 
5 graphics primitive is a non-planar, or high-order, video graphics primitive. A cubic 

Bezier control mesh is calculated using the vertex parameters provided for the non-planar 
video graphics primitive. Two techniques for calculating locations of control points 
included in the cubic Bezier triangular control mesh relating to the edges of the non- 
planar video graphics primitive are described in additional detail below. A location of a 
10 central control point is determined based on a weighted average of the locations of the 
other control points and the locations of the original vertices of the high-order primitive. 
O The resulting cubic Bezier triangular control mesh can then be evaluated using any 

m method for evaluating Bezier surfaces at the vertices of planar video graphics primitives 

5 1 that result from tessellation, where the number of planar video graphics primitives 

m 15 produced can be controlled based on a selected tessellation level. The resulting planar 
S video graphics primitives are then provided to a conventional 3D pipeline for processing 

L to produce pixel data for blending in a frame buffer. 

By allowing the central processor within the video graphics processing system to 
H pass non-planar, or high-order, video graphics primitives to circuitry that generates planar 

W 20 primitives from the high-order primitive using a cubic Bezier triangular control mesh, the 
processing bandwidth needed for video graphics primitive generation within the central 
processor is significantly reduced for 3D applications. Furthermore, the amoimt of data 
that must be sent from the central processor to the circuitry which processes the 
primitives generated by the central processor is greatly reduced as a single high-order 
25 video graphics primitive is sent rather than a large number of planar video graphics 
primitives resulting from tessellation of the high-order video graphics primitive in 
software. An additional benefit may be realized in that hardware may be able to perform 
the calculations required for tessellation more rapidly than is possible in software, thus 
increasing the overall speed of the video graphics processing system. Furthermore, the 
30 resulting planar primitives produced by the hardware tessellation are generally the same 
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as those planar primitives resulting from software tessellation performed in prior art 
systems. As such, no modification to the 3D pipeline is required in order to support 
processing of these planar primitives. 

The invention can be better understood with reference to FIGs, 1-1 5, in which like 
5 reference numerals designate like items. FIG. 1 illustrates a high-order, or non-planar, 
video graphics primitive 10. Video graphics primitive 10 is a triangular primitive that is 
defined by three vertices 12-14. Each of the vertices 12-14 has a corresponding normal 
vector 62-64, wherein the vector 62-64 for each vertex 12-14 indicates a normal to the 
non-planar surface at its corresponding vertex location. Each of the vertices 12-14 is 
1 0 defined in terms of a location in a three-dimensional coordinate space. The edges 1 8-20 
connect the vertices of the high-order primitive 10 to form a boundary of the high-order 
primitive 10. 

Thus, in a video graphics processing system that supports high-order primitives 
10 in accordance with the present invention, the central processor can issue commands to 

15 draw high-order triangles 10, which are defined by three vertices 12-14 and three 
corresponding normals 62-64, to subsequent circuitry that tessellates the high-order 
triangles 10 to produce planar triangles for subsequent processing. In some 
embodiments, the central processor may also produce other types of high-order 
primitives, such as a high-order or curved line that is defined by two vertices and two 

20 normals, where tessellation of the line results in a number of low order lines or segments 
that are subsequently processed by the 3D pipeline. In some embodiments, the central 
processor may also produce planar or low-order primitives that do not require any 
tessellation. In such instances, the circuitry that performs the tessellation may receive an 
indication, or determine based on the data received, that tessellation is not to occur, and 

25 in such cases, the circuitry simply passes these low-order primitives on to the 3D pipeline 
for subsequent processing. 

In order to tessellate a high-order triangle 10 to produce a number of planar 
triangles, a cubic Bezier triangular control mesh is preferably generated to determine the 
three dimensional (3D) coordinates for vertices of planar primitives resulting from 
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tessellation. Generation of a cubic Bezier triangular control mesh is accomplished by 
evaluating a Bernstein polynomial or another function that utilizes such a control mesh to 
determine 3D coordinates for vertices of tessellated primitives. Such evaluation of a 
Bemstein polynomial to derive position coordinates of tessellated primitive vertices is 
5 described in detail below. 

Generation of a cubic Bezier triangular control mesh begins by calculating two 
control points that relate to each edge 18-20 of the high-order primitive 10 based on the 
vertex parameters of the vertices that define that edge 1 8-20. FIG. 2 shows a top down 
view of the high-order primitive 10 in which the vertices 12-14 of the primitive 10 are co- 

1 0 planar, and illustrating control points 22-27 that may or may not lie within a plane and/or 
a boundary of the high-order primitive 10 defined by the vertices 12-14. The positions of 
control points 27 and 22, which relate to edge 18, are calculated based on the positions of 
vertices 13 and 14 and their corresponding normal vectors 63, 64. Similarly, the 
positions of control points 24 and 23, which relate to edge 19, are calculated based on the 

15 positions of vertices 12 and 14 and their corresponding normal vectors 62, 64, Likewise, 
the positions of control points 25 and 26, which relate to edge 20, are calculated based on 
the positions of vertices 12 and 13 and their corresponding normal vectors 62, 63. Thus, 
the control points that relate to a particular edge are determined based on the positions 
and normals of the two vertices that define the particular edge. The relationship between 

20 the control points along an edge and the vertices that define that edge can be exploited in 
video graphics systems where neighboring high-order video graphics primitives share an 
edge, thus providing a means for reducing the total number of calculations that need to 
occur by reusing some control point calculations. Such calculation reuse is described in 
additional detail below with respect to FIG. 12. 

25 FIG. 3 illustrates a graphical representation of a first technique for calculating a 

control point 22 that relates to an edge 18 based on the vertices 13, 14 that define the 
edge 18. The perspective provided by FIG. 3 differs fi-om that shown in FIG. 2. The 
perspective provided in FIG. 3 may be a side view of the high-order video graphics 
primitive 10 where the plane that includes vertices 13 and 14 lies in a generally 

30 horizontal orientation. 
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In order to determine the coordinates for the control point 22, a plane 502 that is 
defined by the normal vector 64 corresponding to vertex 14 is used. The normal vector 
64 is normal to the plane 502. Vertex 13 is projected onto the plane 502 to determine a 
reference point 522. Projection of vertex 1 3 is performed in a direction parallel to the 
5 normal 64 corresponding to vertex 14. The reference point 522 and vertex 14 define a 
reference segment. A fraction of the length of the reference segment is then used to 
define a sub-segment 523 that originates at vertex 14 and extends along the reference 
segment. In one embodiment, the fraction is approximately equal to one-third. In other 
embodiments, the fraction may be v^ithin a range of one-quarter to one-half. The end of 
10 the sub-segment defines the control point 22. This technique for determining the control 
points is preferred for maintaining sharp curvatures in the non-planar primitive 10 such 
that a tight curve is not overly extended. 

5^ FIG. 4 illustrates a graphical illustration of the use of the technique described 

Ifl above with respect to FIG. 3 for determining the location of control point 23 in terms of 

15 its three-dimensional (3D) coordinates. Note that the perspective is along the edge 19 
y that is defined by vertices 12 and 14. Plane 502 is the reference plane defined as normal 

;5 to the normal vector 64 corresponding to vertex 14. Vertex 12 is projected onto the 

reference plane 502 to produce a reference point 532. The projection of vertex 12 is in a 
H direction parallel to the normal 64 corresponding to vertex 14. A sub-segment 533 is 

S 20 defined using a fraction ofthe length ofthe reference segment defined by the reference 

point 532 and vertex 14. The end of the sub-segment 533 determines the location of 

control point 23. 

FIGs. 5 and 6 provide illustrations similar to those of FIGs. 3 and 4, except that a 
slightly different technique is used for determining the coordinates of the control points 

25 22, 23. In FIG. 5, a segment 43 having a predetermined length is determined based on 
the length of edge 18. The segment 43 is mapped onto the plane 502 defined by the 
normal vector 64 of a particular vertex 14 of edge 1 8, such that the segment 43, the 
normal vector 64, and edge 18 are all co-planar. A first end ofthe segment 43 as mapped 
corresponds to vertex 14, and a second end of the segment defines the control point 22. 

30 The length ofthe segment 43 is a fraction ofthe length of the edge 1 8 defined by vertices 



7 



13 and 14, wherein the fraction may be within a range between one-quarter and one-half. 
In one embodiment, the length of the segment 43 is approximately equal to one-third of 
the length of edge 1 8. In other embodiments, the fraction may be specified by a user. A 
register may be used to store the fi*action for use in the computations. 

5 FIG, 6 illustrates a determination of the coordinates for control point 23, wherein 

a segment 45 is mapped onto plane 502 such that the segment 45 is co-planar with edge 
19 and normal 64. Once again, the length of the segment 45 is equal to a fi-action of the 
length of edge 19. 

Once the control points 22-27 related to each of the edges 18-20 have been 
10 determined, a central control point 28 is determined. FIG. 7 illustrates a graphical 

representation of the determination of the central control point 28 using a first technique. 
The position of the central control point 28 is computed using a weighted calculation 
based on at least some of the original vertices 12-14 of the high-order primitive 10 and 
the control points 22-27 related to the edges 1 8-20. In some embodiments, the 
15 combination of the original vertices 12-14 and the control points 22-27 may be based on 
user-specified combining parameters that determine the weighting of the components. In 
a particular embodiment, each of the three vertices 12-14 of the high-order primitive 10 is 
reflected through a corresponding line defined by a pair of control points. For example, 
control points 22 and 23, which are the control points closest to vertex 14, define line 
20 512. By reflecting vertex 14 through line 512, a reference point 74 can be determined. A 
similar projection of vertex 12 through line 514 defined by control points 24 and 25 
produces reference point 72. Likewise, reflecting vertex 13 through line 516 defined by 
control points 26 and 27 produces reference point 73. 

In order to determine the three-dimensional coordinates for the central control 
25 point 28, the coordinates of the reference points 72-74 are averaged. Thus, the x- 

coordinate for the central control point 28 is equal to the sum of the x-coordinates for the 
reference points 72-74 divided by three. Similar calculations are performed for the y, z 
and w-coordinates to obtain the full set of coordinates for the central control point 28. 
For each coordinate, this technique can be simplified to an equation: 
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Central Control Point Coordinate Value ^ V3(Sum of the corresponding coordinate 
values of the other control points 22-27) - Vz (Sum of the corresponding coordinate values 
of the vertices 12-14) 

In another embodiment, the weighted calculation used to determine the 
coordinates of the central control point 28 produces the equation: 

Central Control Point = %(Sum of the other control points 22-27) - 1/6 (Sum of the 
vertices 12-14) 

As is apparent to one of ordinary skill in the art, different weighting factors for the 
coordinate values of the vertices 12-14 and the other control points 22-27 can be used to 
determine the coordinate values of the central control point 28 based on the needs of the 
system or application. 

Once the coordinates of the central control point 28 have been determined, 
determination of the cubic Bezier triangular control mesh is complete. Referring to FIG. 
8, which is in barycentric coordinate space, the coordinates of the vertices corresponding 
to points 12-14 and the control points corresponding to points 22-28 define the complete 
cubic Bezier triangular control mesh. 

Similar to the generation of control points corresponding to points 22-28 for use 
in computing the position components of the vertices of the tessellated or planar graphics 
primitives, additional control points corresponding to points 30-32 are generated for use 
in computing the normal control components (or normals) of the vertices of the 
tessellated primitives. The following equations are used to generate the control points 
corresponding to points 30-32: 

CP30 = N1213 + 2(E20'Ni213)E20 
CP31=Ni413+2(Ei8*Ni413)El8 
CP32=Ni214 + 2(Ei9*Ni214)Ei9, 

where N1213 V2(Ni2+Ni3), 

Ni413 = V^2(Ni4+Ni3), 
N1214 = /2(Ni2+Ni4), 
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E20 = (Vl2-Vi3)/|Vi2-Vi3|, 
El8 = (Vi4-Vi3)/|Vi4-Vi3|. 
El9 = (Vi2-Vi4)/|Vi2-Vii 

Ni2 is the normal 62 corresponding to vertex 12, 
Ni3 is the normal 63 corresponding to vertex 13, 
Ni4 is the normal 64 corresponding to vertex 14, 
Vi2 is the position of vertex 12, 
Vi3 is the position of vertex 13, 
Vi4 is the position of vertex 14, 
CP30 is control point 30, 
CP31 is control point 31, and 
CP32 is control point 32. 



Once the cubic and quadratic Bezier triangular control meshes have been 
determined, tessellation can be achieved by using the control meshes as inputs to 
respective Bernstein polynomials or any other algorithm for evaluating Bezier surfaces. 
Other algorithms for evaluating Bezier surfaces include the de Casteljau algorithm, 
blossoms and any other method for evaluating Bezier surfaces. The Bernstein 
polynomial for determining the position coordinates of the vertices of the tessellated 
primitives provides that if given the control points Pyk, such that the sum of i, j, and k 
equals 3 (i+j+k = 3) and the product of i, j, and k is greater than or equal to zero (ijk > 0), 
a cubic Bezier triangle is defined as 



The Bernstein polynomial for determining the normal components of the vertices 
of the tessellated primitives provides that if given the control points Nyk, such that the 
sum of i, j, and k equals 2 (i+j+k = 2) and the product of i, j, and k is greater than or equal 
to zero (ijk > 0), a quadratic Bezier triangle is defined as 
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w'v-^w^, where u + v + v^= 1. 



il j\k\ 



2 



u'v^w^ , where u + v + w = 1 . 



i\ j\k\ 
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The Bernstein polynomials rely on calculations based on barycentric coordinates 
(u, V, w), wherein barycentric coordinates define an internal reference space for the high- 
order primitive 10. For barycentric coordinates, the sum of the coordinates for a 
particular point within the primitive 1 0 is equal to one. Thus, u + v + w= lat each set of 
(u, V, w) or barycentric coordinates within the primitive 10. Referring to FIG. 9, each of 
the vertices 12-14 is a reference point for a particular barycentric coordinate. At vertex 
12, the first barycentric coordinate (u) is equal to one; whereas the second and third 
barycentric coordinates (v and w) are equal to zero. At vertex 14, the second barycentric 
coordinate (v) is equal to one; whereas the first and third barycentric coordinates (u and 
w) are equal to zero. At vertex 13, the third barycentric coordinate (w) is equal to one; 
whereas the first and second barycentric coordinates (u and v) are equal to zero. Use of 
barycentric coordinates in video graphics processing applications is well known in the 
art, 

hi order to efficiently evaluate the Bernstein polynomials, the points at which the 
polynomials are to be evaluated are selected along lines in which one of the barycentric 
coordinates is constant. Such lines are referred to herein as "iso-parametric lines" and are 
illustrated in FIG. 9 as lines 302-310. Each iso-parametric line 302-310 includes one or 
more vertices of a particular planar tessellated primitive 221-236 that is to be generated 
based on the high-order primitive 10. The benefit of evaluating the Bernstein polynomial 
along iso-parametric lines is that the Bemstein polynomials can be reduced to single 
variable equations. For example, iso-parametric lines 302-310 are lines in which the 
third barycentric coordinate (w) is constant. Thus, the condition u+v+w=l reduces to 
u+v=K, where K is a constant equal to one minus the value of w. Accordingly, the value 
of the v-coordinate equals the value of K minus the value of the u-coordinate and the 
equations defining cubic and quadratic Bezier triangles can be reduced to: 
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u'iK-uy-^ , and 



iljlkl 



2 



m' {K - uy , where w is a constant. 



i\ j\k\ 
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Along line 302, the third barycentric coordinate is not only constant, but also 
equal to zero (i.e., w = 0). Therefore, the Bernstein polynomials can be further simplified 
to: 

A(«) = 2;^,.^t.'(l-«y>.^and 

Line 304 represents a line along which the third barycentric coordinate (w) is 
equal to one-fourth, line 306 represents a line along which the third barycentric 
coordinate is equal to one-half, and line 308 represents a line along which the third 
p barycentric coordinate is equal to three-fourths. By definition, line 310, which intersects 

1 0 vertex 13, represents a line along which the third barycentric coordinate is equal to one. 

m To compute the position components of vertices (e.g., vertex 253) that lie along 

p an iso-parametric line (e.g., line 306), but do not lie along an edge 1 8-20 of the high- 

W order primitive 10, supplemental control points 248, 249, 252, and 263 relating to the 

g particular iso-parametric line 306 are first preferably generated. The supplemental 

^ 1 5 control points include one vertex (e.g., vertex 252 for line 306) of a tessellated primitive 
Q that lies along an edge (e.g., edge 20) and additional control points (e.g., control points 

U 248, 249, and 263) that are generated using the original position control points 22-28 and 

predetermined weighting factors as described in more detail below. Similarly, to 
compute the normal components of vertices that lie along an iso-parametric line (e.g., line 
20 306), but do not lie along an edge 1 8-20 of the high-order primitive 1 0, supplemental 

control points 252, 265, and 266 relating to the particular iso-parametric line 306 are first 
preferably generated. The supplemental control points include one vertex (e.g., vertex 
252 for line 306) of a tessellated primitive that lies along an edge (e.g., edge 20) and 
additional control points (e.g., control points 265 and 266) that are generated using the 
25 original normal control points 30-32 and predetermined weighting factors as described in 
more detail below with respect to FIG. 14. 
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FIG. 10 illustrates tessellated primitives 229 and 234-236 resulting from 
tessellation of the high-order video graphics primitive 10. In order to determine the 
normal vectors 272-276 associated with the newly generated vertices 250-254 of 
tessellated primitives 229 and 234-236, quadratic interpolation is preferably used, in 
5 contrast to the cubic interpolation that is preferably used to obtain the position 

coordinates of the vertices 250-261 of the tessellated primitives 221-236. Typically, 
calculation of the normal vectors 272-276 for each of the newly generated vertices 250- 
254 includes normalization of the results produced through interpolation by a magnitude 
of the particular normal vector 272-276. Thus, normal vector 272 may be derived by 

10 quadratically interpolating between normal vectors 62 and 63, and then normalizing by 
the magnitude of normal vector 272. Normal vector 273 may be determined by 
quadratically interpolating between normal vectors 63 and 64, and then normaUzing by 
the magnitude of normal vector 273. Normal vector 275 may require quadratic 
interpolation utilizing all three of the original normal vectors 62-64 corresponding to the 

15 original vertices 12-14 of the high-order primitive 10. Derivation of the new normal 
vectors 272-276 is preferably accompUshed through evaluation of an appropriate 
Bernstein polynomial as set forth above. A preferred hardware determination of normal 
vectors 272-276 is described below with respect to FIG. 14. 

If additional normal vector accuracy is desired, higher-order interpolation, such as 
20 cubic interpolation, may alternatively be used. Fvirther, linear interpolation with or 

without re-normalization may be used if high-order interpolation is not desired and lower 
accuracy can be tolerated. This gives a closer approximation to Phong shading. 

Other attributes that may be interpolated for each new vertex 250-261 of the 
tessellated primitives 221-236 include texture coordinates, color data values, and fog data 

25 values. Thus, if the central processor provides a high-order video graphics primitive 10 
that includes texture data coordinates corresponding to each of the vertices 12-14 of the 
high-order primitive 1 0, linear or higher-order interpolation operations can be performed 
on the texture coordinates to derive similar texture coordinates for each new vertex 250- 
261 of the tessellated primitives 221-236. The calculations used to determine the various 

30 attributes for each of the new vertices 250-261 of the tessellated primitives 221-236 are 
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preferably performed based on the barycentric coordinates of the vertices 250-261 , which 
allows for simplification of the calculations. 

One of ordinary skill in the art will appreciate that many tessellated primitives 
share edges with other tessellated primitives. For example, the tessellated primitive 235 
5 defined by vertices 250, 25 1 and 253 shares an edge with the tessellated primitive 229 
defined by vertices 250, 252 and 253. Thus, when tessellation is occurring, the 
evaluation of the Bernstein polynomial used to derive the coordinates of vertex 250 of 
tessellated primitive 235 can be reused as a part of the determination of the vertices 250, 
252 and 253 of tessellated primitive 229, Thus, the order in which the position, normal 
10 and attribute components for each new vertex 250-261 of the tessellated primitives 221- 
236 are determined can be, and preferably is, structured such that maximum reuse of 
Q calculations is possible. In a preferred embodiment, as described briefly above and in 

?J more detail below with respect to FIG. 14, the position, normal and attribute components 

til for each new vertex 250-261 of the tessellated primitives 221-236 are determined along 

^ 1 5 iso-parametric lines 302-3 1 0 to facilitate maximum reuse of calculations. 

ffl The number of video graphics primitives produced through tessellation is 

Q determined based on a tessellation level provided by the central processor or stored in a 

f: tessellation level register within the circuitry performing the tessellation. FIG. 1 1 

O illustrates a set of tessellated video graphics primitives 121-124 derived from the high- 

[1 20 order video graphics primitive 10 illustrated in FIG. 1 for a tessellation level of one. The 
tessellation level for the set of tessellated primitives 121-124 in FIG. 1 1 is less than the 
tessellation level associated with the tessellation shown in FIG. 9 wherein FIG. 9 shows a 
tessellation level of three. The tessellation level is the number of new vertices generated 
corresponding to each edge of an input triangle. The greater the tessellation level, the 
25 greater the number of tessellated primitives used to construct the high-order graphics 

primitive 10. The tessellated primitives 121-124 are defined by both the original vertices 
12-14 of the high-order video graphics primitive 10 and the new vertices 131-133. For 
example, for a tessellation level of one, the Bernstein polynomials are evaluated at the 
following u, V, and w values to derive the position and normal components of the new 
30 vertices 131-133 of tessellated primitives 121-124: (0.5, 0.5, 0), (0.5, 0. 0.5), and (0, 0.5, 

14 



0.5), For a tessellation level of two, the Bernstein polynomials are evaluated at the 
following V, and w values to derive the position and normal components of the new 
vertices (i.e., the vertices other than the original vertices 12-14 of the high-order primitive 
10) of the tessellated primitives: (0.67, 0.33, 0), (0.67, 0, 0.33), (0,33, 0.67, 0), (0.33, 
5 0.33, 0,33), (0.33, 0, 0.67), (0, 0.67, 0,33), and (0, 0.33, 0.67), 

As discussed in more detail below with respect to FIG. 14, a tessellation hardware 
implementation may be optimized to substantially reduce the number of processing 
cycles required to compute the position, normal and attribute components for the vertices 
of tessellated primitives for lower tessellation levels (e.g., for tessellation levels of one or 

10 two). Such an optimized lower-level tessellation methodology enables the components of 
the new vertices to be determined directly from the positions and normals 62-64 of the 
original high-order primitive vertices 12-14 without resort to the use of control points 22- 
28, 30-32. That is, instead of computing position and normal control points 22-28, 30-32 
in addition to the original vertices 12-14 themselves and determining vertex components 

15 for each new vertex along iso-parametric lines, the positions and normal components of 
the new vertices 131-133 may be derived directly from the positions and normals 62-64 
of the original vertices 12-14, The positions of the new vertices 131-133 for level one 
tessellation may be determined from the following equations: 

Vi31 = ^/2(Vi3+Vi2) + y8[(Vi3-Ni3)Ni3+ (Vi2-Ni2)Ni2- (Vi3-Ni2)Ni2 - (Vi2-Ni3)Ni3], 

20 Vi32 - ^/2(Vi4+Vi3) + H[(Vi3-Ni3)Ni3 + (Vi4-Ni4)Ni4 - (Vi3-Ni4)Ni4 - (Vi4-Ni3)Ni3], and 

Vi33 = i4(Vl4+Vl2) + l/8[(Vi2*Nl2)Nl2+ (Vi4*Ni4)Ni4 - (Vi4-Ni2)Ni2 - (Vi2-Ni4)Ni4], 

where V131 is the position component (in x, y, z-coordinates) of new vertex 131, V132 is 
the position component of new vertex 132, V133 is the position component of new vertex 
133, V12 is the position component of vertex 12, V13 is the position component of vertex 
25 13, Vi4 is the position component of vertex 14, N12 is the normal component or vector 62 
of vertex 12, N13 is the normal component 63 of vertex 13, and N14 is the normal 
component 64 of vertex 14, 
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The above equations for determining the positions of vertices 131-133 (V131-V133) 
can be rewritten in simplified form respectively as follows: 



Vi31 - ^/2(Vi3+Vi2) + ^/s[(E20-Ni3)Ni3 - (E20-Ni2)Ni2], 

Vi32 = ^/2(Vi4+Vi3) + %[(Ei8-Ni4)Ni4 - (Ei8-Ni3)Ni3], and 

5 V133 = ^/2(Vi2+Vi4) + %[(Ei9-Ni2)Ni2 - (Ei9-Ni4)Ni4], 

where Eis = V13-V14, E19 = V^-Vu, and E20 = V13-V12. In such a simplified form, 
the equations for determining the positions of vertices 131-133 mathematically represent 
one-eighth of the scaled difference between the projections of the edge 18-20 between 
any two consecutive original vertices 12-14 onto the normal components of the 

1 0 consecutive original vertices in a clockwise direction summed with an average of the 
positions of the two consecutive original vertices. For example, the simplified equation 
for Vi3i represents one-eighth the scaled difference between the projection of edge 20 
onto the plane defined by vertex 13 and its normal vector 63, and the projection of edge 
20 onto the plane defined by vertex 12 and its normal vector 62 in the direction of vertex 

15 13 summed with an average of the positions of vertices 1 2 and 1 3 . Similarly, the 
simplified equation for V132 represents one-eighth the scaled difference between the 
projection of edge 18 onto the plane defined by vertex 14 and its normal vector 64, and 
the projection of edge 1 8 onto the plane defined by vertex 13 and its normal vector 63 in 
the direction of vertex 14 summed with an average of the positions of vertices 13 and 14. 

20 Likewise, the simplified equation for V133 represents one-eighth the scaled difference 
between the projection of edge 19 onto the plane defined by vertex 12 and its normal 
vector 62, and the projection of edge 19 onto the plane defined by vertex 14 and its 
normal vector 64 in the direction of vertex 12 summed with an average of the positions of 
vertices 12 and 14. Thus, using the above equations, the positions and normal 

25 components of the new vertices 1 3 1 - 1 3 3 for level one tessellation may be derived 
without generating control points, thereby saving processing cycles and improving 
graphics hardware processing throughput. 
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The normal components of the new vertices 131-133 for level one tessellation 
may be determined from the following equations, where N131-N133 are the normal 
components for new vertices 131-133, V12-V14 are the respective position components of 
original vertices 12-145 and N12-N14 are the respective normal vectors 62-64 of original 
vertices 12-14: 

Ni3i = V2 (Ni3 +N14) - ^/8[Ei8-Ni3 + Ei8-Ni4][Ei8/|Ei8p], 

Ni32 = Vz (N12 +N13) - y8[E2o-Ni2 + E2o-Ni3][E2o/|E2oP], and 

N133 = Vz (Ni2 +Ni4) - y8[Ei9-Ni2 + Ei9-Ni4][Ei9/|Ei9ft, 

where Eig = V13-V14, E19 = V12-V14, and E20 = V13-V12, 

FIG, 12 illustrates a high-order video graphics primitive 1 10 that neighbors high- 
order video graphics primitive 10 along edge 20. In many cases, some or all of the 
calculations used to determine the control points 12, 13, 25, 26 that relate to edge 20 for 
high-order primitive 10 (as well as calculations used to determine vertex parameters for 
certain vertices, such as vertex 131, that lie along edge 20) can be reused in the 
tessellation operation of high-order video graphics primitive 110. This is especially true 
if the tessellation level used for tessellating high-order video graphics primitive 1 10 is the 
same as the tessellation level used to tessellate high-order video graphics primitive 10. 
Since neighboring high-order video graphics primitives 10, 1 10 are typically presented to 
the circuitry performing the tessellation in a close temporal order, a limited amount of 
buffering circuitry may be required to ensure that the values resulting from calculations 
along or relating to a common edge 20 of two high-order video graphics primitives 10, 
1 1 0 can be stored for potential future reuse. 

The resulting primitives produced through tessellation are provided to the 3D 
pipeline as planar primitives. Each of the vertices of each planar triangle primitive may 
be presented to the 3D pipeline along with a planar primitive vertex normal and possibly 
other vertex attributes corresponding to texture coordinates, color data, and/or fog data. 
The planar primitive vertex normal for each planar primitive may be normalized after the 
interpolation operations used to derive such planar primitive vertex normals. 
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FIG. 13 illustrates a high-level block diagram of a video graphics processing 
system 400 in accordance with a particular embodiment of the present invention. The 
video graphics processing system 400 includes a processor 410, a control point 
generation block 420, a tessellation block 430, a 3D pipeline 440, and a frame buffer 450. 
The processor 410 may be the central processor of a computer system or any other 
processing unit or group of processing units that generates high-order video graphics 
primitives corresponding to objects for display. Each high-order graphics primitive 
produced by the processor 410 is defined at least by the three-dimensional (3D) 
coordinates of its vertices as well as a normal vector corresponding to each vertex. Thus, 
for a triangular high-order video graphics primitive 10, at least the position coordinates 
and the normal vectors 62-64 for each of the three vertices 12-14 of the primitive are 
produced by the processor 410. 

The control point generation block 420 receives the high-order video graphics 
primitives 10 from the processor 410 and generates one or more control meshes 
corresponding to each high-order video graphics primitive. For example, the control 
point generation block 420 preferably generates two Bezier control meshes, one for use in 
computing vertex position components of the tessellated primitives and the other for 
computing the normal components or vectors of the tessellated primitives. In the case of 
triangle primitives, the position Bezier control mesh is preferably a cubic Bezier 
triangular control mesh; whereas, the normal Bezier control mesh is preferably a 
quadratic Bezier triangular control mesh. The operations performed by the control point 
generation block 420 include those for generating all the position and normal control 
points 22-28, 30-32, including generating additional points that are various combinations 
of the position and normal control points 22-28, 30-32, These additional points are used 
to compute supplemental control points 248, 249, 263, 265, and 266 related to the iso- 
parametric lines 302-310 as was briefly discussed above with respect to FIG. 9 and is 
described in more detail below with respect to FIG. 14. In order to perform vector 
calculations, the control point generation block 420 is preferably coupled to, or includes, 
at least one vector engine that performs calculations associated with generating the 
control meshes. 
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Based on the control meshes generated by the control point generation block 420, 
the tessellation block 430 tessellates each high-order video graphics primitive to produce 
a group of low-order planar primitives. The level of tessellation performed by the 
tessellation block 430 may be based on information received from the processor 410 or 
5 based on a tessellation level that may be configured for the video graphics processing 
system. The control point generation block 420 and the tessellation block 430 together 
form part of a high-order primitive processing unit 460 and are preferably implemented 
in hardware residing on a video graphics card. Alternatively, both blocks 420, 430 may 
be implemented in software executed by the processor, although such an implementation 
10 may result in reduced processing speed as compared to the preferred hardware 

implementation. A preferred hardware implementation of the high-order primitive 
processing unit 460, including control point generation block 420 and tessellation block 
430, is described in detail below with respect to FIGs. 14 and 15. 

Tessellation by the tessellation block 430 includes at least a determination as to 
1 5 the position coordinates for each of the vertices of the planar video graphics primitives 
resulting from tessellation. These coordinates may be determined by using a cubic Bezier 
control mesh to evaluate the Bernstein polynomial or other algorithm at various points 
within the high-order video graphics primitive 10 based on the tessellation level. The 
evaluation of the Bernstein polynomial preferably utilizes barycentric coordinates in 
20 order to simplify calculations. Additional vertex parameters corresponding to the vertices 
of each of the planar video graphics primitives may also be determined. These vertex 
parameters can include normal vectors, which are preferably based on quadratic 
interpolation, but may be alternatively based on linear or higher-order interpolation 
(where the results are normalized), as well as other attributes, such as color data, fog data, 
25 and texture coordinate data. 

The results produced by the tessellation block 430 are planar primitives that 
include the appropriate vertex data required for the 3D pipeline 440 to perform known 
operations, such as transform processing, Ughting processing, clipping processing, and 
rasterization. The 3D pipeline 440 receives the planar primitives and generates pixel data 
30 that may be combined with data stored in the frame buffer 450. The data stored in the 
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frame buffer 450 can then be used to generate a display signal that results in an image 
being drawn on a display. The 3D pipeline 440 may be a conventional 3D pipeline used 
for processing planar video graphics primitives. 

FIG. 14 illustrates a block diagram of a preferred high-order primitive processing 
unit 460 for use in the video graphics processing system 400 of FIG. 13. The high-order 
primitive processing unit 460 includes a high-order surface (HQS) thread controller 1401, 
an arbitration module 1403, one or more computation engines 1405, 1406 (two shown), 
various memory 1408-1413, a plurality of lookup tables 1415-1417, and a swappable 
memory 1418. The HOS thread controller 1401 preferably includes a plurality of state 
machines 1419-1422 and an arbiter 1427. As described in greater detail below, walking 
state machine 1419 functions as a high level state machine to direct the lower-level 
position, normal and attribute state machines 1420-1422. The position and normal state 
machines 1420, 1421 issue commands for computing the position and normal control 
points 12-14, 22-28, 30-32 and the vertices of the tessellated primitives. The attribute 
state machine 1422 issues commands for computing the remaining parameters or 
attributes of the vertices of the tessellated triangles. Each state machine 1419-1422 is 
preferably implemented in hardware as a logic circuit and a synchronous circuit 
embodied in an integrated circuit. 

In a preferred embodiment, the HOS thread controller 1401, the arbitration 
module 1403, and the computation engines 1405, 1406 are all implemented in an 
hitegrated circuit located on a video graphics card together with the HOS computation 
memory 1410, the output data flow memories 141 1, 1412, the TCL input vertex memory 
1413, the lookup tables 1415-1417, the swappable memory 1418, and the TCL input 
vertex status register 1429. The vertex memory 1408 and the primitive list buffer 1409 
may also use memory locations on the video graphics card at the option of the application 
running on the processor 410. 

As discussed in more detail below, the swappable memory 1418 includes 
respective areas 1448-1450 for temporarily storing control point and other interpolation 
data for use in computing the positions, normals, and attributes for the supplemental 
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vertices of the tessellated primitives (e.g., primitives 221-236 of FIG. 9). The control 
point data stored in the sw^appable memory 1418 includes data for control points 22-28, 
30-32, data for the original vertices 12-14 of the high-order primitive 10 when such 
vertices 12-14 are used as control points, and data for supplemental control points (e.g., 
5 vertex 252 and additional control points 248, 249, 263, 265 and 266) used for computing 
position and normal components of one or more vertices (e.g., vertex 253) that are 
located within the boundary of the high-order primitive 10 and that lie along iso- 
parametric lines 302-310. Each area 1448-1450 of swappable memory 1418 is preferably 
implemented as an arrangement of registers that allow the data to be written into the 

10 respective area's memory registers in rows, but be read from the registers in columns. In 
addition, the swappable memory 1418 is preferably double-buffered. That is, the 
swappable memory 1418 includes two sections of memory for each memory area 1448- 
1450. When one section of a memory area 1448-1450 is being read from by one or more 
of the computation engines 1405, 1406, the other section of the memory area 1448-1450 

15 may be simultaneously written to by one or more of the computation engines 1405, 1406. 

During operation, the processor 410 stores vertex parameters for the vertices 12- 
14 of the high-order primitives 10 in vertex memory 1408. The vertex parameters 
generally include position components (e.g., x, y, z, and w position coordinates) and 
normal components (vectors), and may also include various attributes, such as texture 

20 coordinates, color data, fog data and/or other attributes. In addition, the processor 410 
stores a corresponding list of vertices or vertex indices associated with each high-order 
primitive 1 0, an indication (e.g., bitmap) of whether or not the parameters for each vertex 
of the primitive 10 have been completely stored in the vertex memory 1408, and a 
tessellation level in a primitive list buffer 1409. Alternatively, the tessellation level may 

25 be pre-stored in a register within the HOS thread controller 1401 when the video graphics 
system utilizes a fixed tessellation level. Thus, the primitive list buffer 1409 preferably 
indicates which vertices make up the high-order primitive 10, which vertices of the high- 
order primitive 10 have associated vertex parameters completely stored in the vertex 
memory 1408, and the tessellation level selected by the processor 410 (e.g., an 

30 application running in the processor 41 0) to construct the high-order primitive 10. 
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The walking state machine 1419 continually checks the primitive list buffer 1409 
and once all the vertex parameters for the vertices 12-14 of the high-order primitive 10 
are indicated as being stored in the vertex memory 1408, the walking state machine 1419 
begins issuing operation codes to the lower-level state machines 1420-1422 to generate 
tessellated primitives in accordance with the tessellation level. Each operation code 
issued by the walking state machine 1419 includes a type of operation to be performed, 
and may include a source address, a destination address, and a vertex position of one of 
the higher-order primitive vertices 12-14 in terms of barycentric coordinates. The vertex 
position is of the form (u, v, w), where each of u, v, and w is an integer greater than or 
equal to zero and the sum of u, v and w is equal to the tessellation level plus one. The 
vertex position is used primarily for computing linearly interpolated attributes of the new 
vertices of the tessellated primitives. The source address is the address of the lookup 
table 1415-1417 where the data for a particular computation to be performed is stored. 
The destination address is the address of the TCL input vertex memory 1413, output data 
flow memory 1411, 1412 or HOS computation memory 1410 where the computation 
result is to be stored for further processing (e.g., transformation, clipping, and lighting 
(TCL) processing or use in determining parameters of other vertices of the tessellated 
primitives). The HOS computation memory 1410 basically serves as an intermediate 
data flow memory that stores the resultant 1437, 1438 of one or more HOS processing 
operations performed by the computation engines 1405, 1406 for use in subsequent HOS 
processing operations to be performed by the computation engines 1405, 1406. 

The walking state machine 1419 preferably issues operation codes in such as way 
as to require the high-order primitive processing unit 460 to generate vertices of 
tessellated triangles along iso-parametric lines (i.e., lines in which a barycentric 
coordinate is constant). By generating vertices along iso-parametric lines, vertex 
parameter computations for such vertices may be optimally used and reused in such a 
manner as to maximize processing efficiency. That is, in the preferred embodiment, the 
vertex parameters for each tessellated vertex are computed only once and are used and 
reused as necessary to complete processing of each tessellated primitive that includes the 
vertex. 
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After receiving a particular operation code from the walking state machine 1419, 
the lower-level state machines 1420-1422 begin issuing series of operation codes and 
transitioning through one or more states to control the execution of the operation issued 
by the walking state machine 1419. One or more of the lower-level state machines 1420- 
5 1422 may wait for another one of the lower-level state machines 1420-1422 to indicate 
completion of an operation (e.g., a change of state) before issxxing operation codes for its 
particular state. For example, the normal state machine 1421 preferably waits until it 
receives a flag from the position state machine 1420 indicating the generation of certain 
position control points 22-28 before issuing commands or operation codes to generate 
10 normal control points 30-32 because computation of the normal control points 30-32 
preferably reuses many of the computations carried out to generate the position control 
points 22-28, thereby reducing computational redundancy and improving processing 
efficiency. 

The operation codes issued by the position state machine 1420 are directed 
1 5 primarily at computing x, y, and z-components of position control points (e.g., control 
points 12-14, 22-28, 248, 249, 252, and 263 in FIGs. 8 and 9) and the positions of the 
vertices (e.g., vertices 12-14 and 250-261 in FIG. 9) of the tessellated triangle primitives 
(e.g., primitives 221-236 in FIG. 9). The operation codes issued by the normal state 
machine 1421 are directed primarily at computing the x, y, and z-components of normal 
20 control points (e.g., control points 12-14, 30-32, 265, and 266) and the normals of the 
vertices of the tessellated primitives. The operation codes issued by the attribute state 
machine 1422 are directed primarily at computing the remaining attributes (e.g., texture, 
fog, color, etc.) of the vertices of the tessellated primitives. 

The operation codes issued by the lower-level state machines 1420-1422 are input 
25 to an arbiter 1427 for selection of a single operation code 143 1 to be delivered to the 

arbitration module 1403. The HOS arbiter 1427 selects one of the operation codes issued 
by the lower-level state machines 1420-1422 for delivery to the arbitration module 1403 
preferably based on a prestored prioritization scheme. In a preferred prioritization 
scheme, operation codes related to position computations (i.e., operation codes issued by 
30 the position state machine 1420) are given highest priority followed by operation codes 
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related to vertex normal computations and attribute computations, respectively. In an 
alternative embodiment, the HOS arbiter 1427 may select one of the operation codes 
issued by the lower-level state machines 1420-1422 based on the status of a priority flag 
or other indication forming part of the operation code, or simply in a round robin manner. 
Therefore, in sum, the HOS thread controller 1401 issues operation codes 1431 for 
generating control points and the vertex parameters of the vertices of the tessellated 
primitives under the hierarchical control of the walking state machine 1419 and the 
lower-level state machines 1420-1422. 

In the preferred embodiment, the arbitration module 1403 receives operation 
codes 1431, 1433 from the HOS thread controller 1401 and one or more other thread 
controllers (only the HOS thread controller 1401 is shown). Each of the non-HOS thread 
controllers (not shown) manages a corresponding thread for, inter alia, determining the 
vertices and associated attributes of primitives to be rendered, performing transform 
operations on the vertices, performing clipping operations on the primitives, determining 
lighting effects, and determining texture coordinate values. Each thread is a sequence of 
operation codes 1431, 1433 that are executed under the control of the corresponding 
thread controller. Each operation code 1431, 1433 includes a thread identifier that 
identifies the particular thread controller that issued the operation code 1431, 1433, a type 
of operation to be performed, one or more optional source addresses, and an optional 
destination address. When an operation code 1431, 1433 is provided to one of the 
computation engines 1405, 1406, the computation engine 1405, 1406 executes the 
operation using data stored in source addresses and stores the result in a destination 
address (e.g., in the HOS computation memory 1410, the swappable memory 1418, or an 
output data flow memory 1411, 1412 for subsequent transmission to the TCL input vertex 
memory 1413). The source addresses and destination address may be predetermined 
based on the particular operation of the particular thread being executed (e.g., the 
particular state of the walking state machine 1419). As such, memory contention is 
eliminated, and the need for a memory controller is also eliminated. The elimination of 
memory contention is discussed in greater detail with reference to FIG. 15 below. 
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The HOS thread controller 1401 and the other thread controllers preferably issue 
operation codes 1431, 1433 only when the operation codes 1431, 1433 can be executed 
by a computation engine 1405, 1406 without any potential for delay in waiting for the 
results of previously issued operation codes. For example, when an operation code is 
5 dependent on the results of a previously issued operation code, the thread controller 1401 
will not release the dependent operation code until a certain amount of time has passed 
corresponding to the latency associated with executing the operation code that produces 
the data required by the dependent operation code. Preferably, each thread controller 
1401 only issues one operation code at a time. 

10 The arbitration module 1403 receives the operation codes 143 1, 1433 from the 

thread controllers and, based on a prioritization scheme, orders the operation codes 143 1 , 
1433 for execution by the computation engines 1405, 1406. In a preferred embodiment, 
two computation engines 1405, 1406 are utilized in the high-order primitive processing 
unit 460 to improve overall processing efficiency. Both computation engines 1405, 1406 

15 preferably support multiple threads via the arbitration module 1403, as opposed to being 
dedicated to processing operation codes issued by a single thread controller. By 
supporting multiple threads, the computation engines 1405, 1406 are more likely to 
maintain balanced processing loads. For example, not all graphics scenes use high-order 
primitives 10 that require tessellation. Accordingly, a single computation engine 1405 

20 dedicated to support the operation codes 143 1 issued by the HOS thread controller 1401 
would not optimally utilize the processing resources of the engine 1405 because not all 
graphics primitives may require high-order primitive processing. In an alternative 
embodiment, a single computation engine 1405 may be used provided that the processing 
speed of the engine 1405 is sufficient to execute operation codes without introducing 

25 noticeable delays in the processing of any one particular thread. 

The arbitration module 1403 provides the operation codes to the computation 
engines 1405, 1406 in an ordered serial manner, such that loading of both engines 1405, 
1406 is approximately equal. The ordered operation codes are preferably provided to 
each computation engine 1405, 1406 at the processing rate of the respective computation 
30 engine 1405, 1406, such that each computation engine 1405, 1406 is fully utilized (i.e., 
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the pipeline included in the computation engine 1405, 1406 is kept full). The order in 
which the operation codes 1431, 1433 are provided to the computation engines 1405, 
1406 follows a prioritization scheme that may be dependent upon the application being 
executed by the processor 410 and/or a prioritization flag or other indication issued by 
one or more of the thread controllers. For example, since the processing of graphics 
primitives is very structured, an application-specific prioritization scheme may prioritize 
operations in a back-to-front maimer that ensures that processing that is nearing 
completion is prioritized over processing that is just beginning. Prioritizing the final 
steps to produce results passed to downstream circuitry may help to ensure that the 
resources in the pipeline of the computation engine 1405, 1406 are efficiently utilized and 
a regular production rate of results can be maintained. Alternatively, or in addition to an 
application-specific prioritization scheme, the HOS thread controller 1401 may include a 
priority indication (e.g., a single bit flag or a set of bits) in certain operation codes 1431 
based on a quantity of vertices of tessellated primitives awaiting subsequent processing 
(e.g., transform, clipping, and lighting processing), thereby prioritizing high-order 
primitive processing particularly when transform, clipping, and lighting processing (TCL 
processing) is completing more rapidly than high-order primitive processing. 

The computation engines 1405, 1406, which are discussed in greater detail below 
with respect to FIG. 15, receive the ordered operation codes from the arbitration module 
1403 and execute the operations contained in the codes to generate computational 
resultants 1437-1441. The ordered operation codes are received by the computation 
engines 1405, 1406 in a synchronized manner corresponding to the respective operating 
rates of the engines 1405, 1406. The objective of the arbitration module 1403 is to order 
the operation codes 1431, 1433 such that each computation engine 1405, 1406 operates at 
capacity (i.e., the pipeline within each computation engine 1405, 1406 is always full and 
the resources in each computation engine 1405, 1406 are efficiently utilized). Thus, for 
every operation cycle of each computation engine 1405, 1406, the arbitration module 
1403 attempts to provide each computation engine 1405, 1406 with an operation code for 
execution. 
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As stated above, each operation code 1431, 1433 typically includes at least one 
corresponding source address from which the computation engine 1405, 1406 is to 
retrieve data or other information (e.g., an operand) to be used in executing the operation 
code. The source address is an address of a memory or a lookup table coupled to the 
computation engine 1405, 1406. For example, as described in more detail below, the 
operation codes 1431 issued by the HOS thread controller 1401 typically include one or 
more source addresses associated with one or more of the vertex memory 1408, the HOS 
computation memory 1410, the swappable memory 1418 and the lookup tables 1415- 
1417, However, some operation codes may not include source addresses because such 
addresses may be hard-coded into an address generation imit (not shovra) positioned 
between the arbitration module 1403 and the computation engines 1405, 1406 in 
accordance with a fixed tessellation rule set. The computation engines 1405, 1406 use 
the data retrieved from the source address or addresses to produce the computational 
resultants 1437-1441. The resultants 1437-1441 produced by each computation engine 
1405, 1406 are stored in one of several memories 1410-1413, 1418 at locations that may 
be based on a destination address determined from attributes of the received operation 
codes (e.g., thread identity, operation performed, etc.). By providing a dedicated memory 
for each result produced by the computation engines 1405, 1406, memory contention is 
eliminated. Such segmentation of system memory is described in additional detail with 
respect to FIG. 15 below. As stated above, each operation code 1431, 1433 either 
includes the corresponding source and destination addresses required for execution or has 
such addresses hard-coded in accordance with a fixed rule set. The utilization of such 
predetermined memory locations eliminates the need for a memory controller that 
maintains the location of various pieces of data. 

Exemplary operation of the preferred high-order processing unit 460 may be more 
clearly described with reference to the generation of the position control points 12-14, 22- 
28 and the normal control points 12-14, 30-32 depicted in FIG. 8, the determination of 
the position components of edge vertices 250-252 and 254 of tessellated primitives 229 
and 234-236 depicted in FIG. 9, the determination of the normal components 272-274, 
276 of edge vertices 250-252 and 254 depicted in FIG. 10, the generation of supplemental 
position and normal control points 248, 249, 252, 263, 265 and 266 depicted in FIG. 9, 
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and the determination of the position component and the normal component 275 of vertex 
253 lying on iso-parametric line 306 as depicted in FIGs. 9 and 10. During execution of 
an application requiring high-order graphics primitives 10 to be drawn, the processor 410 
stores the vertex parameters for each high-order primitive 10 in the vertex memory 1408. 
5 In addition, the processor 410 stores the primitive list and preferably the tessellation level 
for each high-order primitive 10 in the primitive list buffer 1409. The tessellation level 
associated with generating the tessellated primitives 221-236 of FIG. 9 is three. 

After all the vertex parameters for a particular high-order primitive 1 0 have been 
stored in the vertex memory 1408 as indicated by a validation bitmap stored in the 
primitive list buffer 1409, the walking state machine 1419 issues an operation code to the 
position and normal state machines 1420, 1421 (e.g., sets a flag to be read by the position 
and normal state machines 1420, 1421), wherein the operation code instructs the position 
and normal state machines 1420, 1421 to generate respective control points (e.g., control 
points 12-14 and 22-28 for position, and control points 12-14 and 30-32 for normal) and 
determine the position and normal components of the vertices 12-14, 250-261 of the 
tessellated primitives 221-236 for the high-order primitive 10. Unless otherwise 
indicated herein, the following description of the operation of the high-order processing 
unit 460 will be presented for a tessellation level of three, resulting in sixteen tessellated 
primitives 221-236 as illustrated in FIG. 9. One of ordinary skill in the art will recognize 
that the present invention may be utilized to tessellate high-order primitives in 
accordance with any desired tessellation level. 

Responsive to receiving the startup operation code from the walking state 
machine 1419 (e.g., detecting that a particular walking state machine flag is set), the 
position and normal state machines 1420, 1421 proceed through a series of states in 
25 which the state machines 1420, 1421 issue respective series of operation codes to 

generate their respective control points 12-14, 22-28, 30-32. In addition, the walking 
state machine 1419 issues another operation code (e.g., sets another flag) instructing the 
lower-level state machines 1420-1422 to generate a first supplemental vertex (e.g., 
original vertex 13 in FIG. 9) and enter a wait mode. As used herein, the term 
30 "supplemental vertex" refers to a vertex 12-14, 250-261 of one of the tessellated 
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primitives 221-236 and includes each original vertex 12-14 of the high-order primitive 10 
because the original vertices 12-14 are also vertices of tessellated primitives 221, 230, 
and 236. 

To compute their respective control points 12-14, 22-28, 30-32, the position and 
5 normal state machines 1420, 1421 issue operation codes instructing the computation 
engine 1405, 1406 selected by the arbitration module 1403 to compute the control points 
12-14, 22-28, 30-32 in x, y, z-coordinates based on the position coordinates and normals 
62-64 of the original vertices 12-14 of the high-order primitive 10 as described in detail 
above. The operation codes issued by the position and normal state machines 1420, 1421 

10 also instruct the computation engines 1405, 1406 to store the newly generated control 
points 22-28, 30-32 in the HOS computation memory 1410 for use during generation of 
the position and normal components of the vertices 12-14, 250-261 of the tessellated 
primitives 221-236. Control points 12-14 are already preferably stored in the vertex 
memory 1408 since they are original vertices of the high-order primitive 10 and, 

15 therefore, are not re-stored in the HOS computation memory 1410 (although they could 
be), unless the position coordinates of the vertices 12-14 are scaled or homogenized by 
the "w" position coordinate in an x, y, z, w-coordinate system (as opposed to the "w" 
barycentric coordinate) in instances where the w-coordinate is not equal to one. 

With respect to generating control points 22-28 and 30-32 in response to receiving 
20 corresponding operation codes from the position and normal state machines 1420, 1421, 
one or both of the computation engines 1405, 1406, at the direction of the arbitration 
module 1403, perform all (if only one engine is selected to compute the control points 22- 
28, 30-32) or some (if both engines 1405, 1406 are used) of the control point generation 
operations described above with respect to FIGs. 3-4 and 7 or FIGs. 5-7 depending on 
25 which approach is selected for computing control points 22-28. For example, to compute 
control point 22 as illustrated in FIG. 3, the selected computation engine 1405, 1406 first 
computes the projection of vertex 13 onto plane 503 by performing a vector dot product 
to determine reference point 522. In order to perform this computation, the selected 
computation engine 1405, 1406 retrieves the position and normal components of vertex 
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14 and the position components of vertex 13 from the vertex memory 1408. The 
computed result (reference point 522) is stored in the HOS computation memory 1410. 

Next, the selected computation engine 1405, 1406 computes the reference sub- 
segment 523 by first using vector addition to compute the reference line segment between 
vertex 14 and reference point 522 and then using vector multiplication on the reference 
line segment to compute the fraction representing the reference sub-segment 523. To 
perform these computations, the selected computation engine 1405, 1406 retrieves the 
reference point computation results 1435 (reference point 522) from the HOS 
computation memory 1410 and the position components of vertex 14 from either the 
vertex memory 1408 (in most cases) or the HOS computation memory 1410 (only in 
certain cases when the reference point position is scaled or homogenized by the "w" 
position coordinate in an x, y, z, w-coordinate system (as opposed to the "w" barycentric 
coordinate) in instances where the w-coordinate is not equal to one). For example, if the 
position components of the reference point 522 need to be homogenized the w-coordinate 
before control point generation (e.g., if (x, y, z, w) must be represented as (x/w, y/w, z/w, 
1) because the w-coordinate is not equal to one), the new homogenized position 
coordinates (x/w, y/w, z/w, 1) are stored in the HOS computation memory 1410 and used 
for control point generation. The reference sub-segment computation results are also 
stored in HOS computation memory 1410. 

Lastly, the selected computation engine 1405, 1406 computes the position of 
control point 22 as the end of the reference sub-segment 523 using vector addition. To 
perform this last computation, the selected computation engine 1405, 1406 retrieves the 
reference sub-segment computation 1435 from HOS computation memory 1410 and the 
position components of vertex 14 from the vertex memory 1408 or the HOS computation 
memory 1410 (when the vertex position components are homogenized). The remaining 
position control points 23-28 are determined through similar data retrieval, vector 
computation, and resultant storage in accordance with operation codes issued by the 
position state machine 1420 implementing the methodologies described above with 
respect to FIGs. 3-7. 
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The normal control points 30-32 are computed by the computation engines 1405, 
1406 in a similar manner in response to operation codes issued by the normal state 
machine 142L The operation codes provide step-by-step instructions for evaluating the 
control point equations for CP30-CP32 set forth above with respect to FIG. 8. The normal 
5 control points 30-32 and any intermediate resultants derived in computing the control 
points 30-32 are stored in the HOS computation memory 1410, with the intermediate 
resultants being deleted once their use is no longer necessary. 

After the position and normal state machines 1420, 1421 have computed their 
respective control points 12-14, 22-28, 30-32, the state machines 1420, 1421 read the 
walking state machine flag and thereby receive an operation code from the walking state 
machine 1419 instructing them to begin generating the first supplemental vertex (e.g., 
vertex 13 in FIG. 9). After each lower-level state machine 1420-1422 completes its 
processing with respect to the first supplemental vertex (i.e., respectively generating the 
position, normal, and other attributes of the first supplemental vertex), the particular state 
machine 1420-1422 sets a flag indicating completion of its respective processing. The 
walking state machine 1419 periodically (e.g., once a clock cycle) checks the status of the 
lower-level state machine completion flags. Once the walking state machine 1419 
detects that the completion flag for each lower-level state machine 1420-1422 is set 
indicating completion of generation of the first supplemental vertex, the walking state 
machine 1419 sets its vertex generation flag again (which had been reset once vertex 
processing began on the first supplemental vertex) instructing the lower-level state 
machines 1420-1422 to begin generating the next supplemental vertex (e.g., vertex 250 in 
FIG. 9). This sequence continues imtil all the supplemental vertices for a particular level 
of tessellation have been generated. More details with respect to the computation of 
individual supplemental vertices 12-14, 250-261 is provided below. 

In addition, as discussed above, the processing completion flag of one lower-level 
state machine 142-1422 may be used by another lower-level state machine 1420-1422 as 
a trigger to begin issuing operation codes. For example, the normal state machine 1421 
preferably waits until it receives a flag from the position state machine 1420 indicating 
30 the generation of certain position control points 22-28 before issuing commands or 
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operation codes to generate normal control points 30-32 because computation of the 
normal control points 30-32 preferably reuses many of the computations carried out to 
generate the position control points 22-28. 

When the arbitration module 1403 selects a HOS operation code 143 1 for 
processing, the arbitration module 1403 provides the code to one or both of the 
computation engines 1405, 1406 depending on the type of instruction represented by the 
code 143L Li the preferred embodiment, the use of two computation engines 1405, 1406 
enables the position, normal and/or attribute components of the new vertices 250-261 of 
the tessellated primitives 221-236 to be computed in fewer processing cycles (e.g., two 
processing cycles for position components x, y, z, and w, as opposed to four cycles with a 
single computation engine). In the preferred embodiment, the lower-level state machines 
1420-1422 of the HOS thread controller 1401 issue both single instruction operation 
codes and double instruction operation codes. The single instruction code instructs the 
arbitration module 1403 to assign the code to one of the computation engines 1405, 1406 
for execution. The double instruction codes instruct the arbitration module 1403 to 
assign one instruction code to one computation engine 1405 and another instruction code 
to the other computation engine 1406 for execution preferably during the same 
processing cycle. For example, to compute the position coordinates (x, y, z, w) for each 
of the new vertices 250-261 of the tessellated primitives 221-236, the position state 
machine 1420 preferably issues a double instruction operation code, such that one 
computation engine 1405 computes the x-coordinate in one processing cycle and the z- 
coordinate in the next processing cycle, and the other computation engine 1406 computes 
the y-coordinate in the same processing cycle in which the x-coordinate is computed and 
computes the w-coordinate in the same processing cycle in which the z-coordinate is 
computed. In this manner, the position coordinates of each new vertex 250-261 are 
computed in two processing cycles, as opposed to four cycles with a single computation 
engine. Similarly, the normal state machine 1421 and/or the attribute state machine 1422 
may issue single or double instruction codes to reduce the processing time associated 
with computing vertex normals and attributes. 
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As discussed above, the swappable memory 1418 is used to store control point 
data on an as-needed basis for use in computing the positions, normals, and attributes for 
the supplemental vertices 12-14, 250-261 of the tessellated primitives 221-236. The 
swappable memory 1418 is preferably double-buffered. Thus, v^hen a computation 

5 engine 1405 reads from one area of the swappable memory 1418 (e.g., the position area 
1448), the computation engine 1405 or another computation engine 1406 may write to the 
same area 1448 (in another section) or another area 1449, 1450 of swappable memory 
1418 in the same clock cycle. For example, after position control points 22-28 of FIG. 8 
are computed and stored in the HOS computation memory 1410, the computation engines 

1 0 1405, 1406, responsive to operation codes issued by the position state machine 1420, 
copy or write control points to be used in a particular position computation (e.g., control 
points 12, 13, 25 and 26 where original vertices 12 and 13 are being used as control 
points and the position of a vertex along edge 20 is to be computed) into registers in the 
position area 1448 of the swappable memory 1418. As discussed above, the areas 1448- 

1 5 1450 of swappable memory 141 8 are implemented such that data may be written into 
each area's memory registers in rows, but be read from the registers in columns. After 
the particular control points have been read into the position area 1448 of the swappable 
memory 1418, the computation engines 1405, 1406 read the stored data as column 
vectors from the position area 1448 and perform a vector dot product operation with a 

20 selected entry of one of the lookup tables 1415-1417 to compute a position component of 
a new supplemental vertex 250-261 or a supplemental control point 248, 249, 263. For 
instance, as described in more detail below, the x-component of supplemental vertex 250 
is derived by reading the x-components of vertex 12, control point 25, control point 26, 
and vertex 13 (i.e., a colimm vector) from the position area 1448 of the swappable 

25 memory 1418 and performing a dot product between the read x-components and 

weighting factors stored in the edge lookup table 1415, wherein the weighting factors are 
associated with control points 12, 25, 26, 13 that have an index in which the j -component 
of the control point variable Pyk (e.g., P300? ^20h P102? P003) in the cubic Bezier triangle 
equation equals zero. 

30 As illustrated in FIG. 9 and discussed in detail above, the vertices of the 

tessellated primitives 221-236 include the three original vertices 12-14 of the high-order 
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primitive 10, These three vertices 12-14 also serve as control points for generating the 
supplemental vertex positions and normals. 

To compute the positions of the supplemental vertices 12-14, 250-261, the 
walking state machine 1419 sets a flag instructing the lower level state machines 1420- 
5 1421 to process the first supplemental vertex. The first supplemental vertex is preferably 
one of the original vertices 12-14. For purposes of this discussion, the first supplemental 
vertex is original vertex 13. 

Responsive to detecting the walking state machine's set flag, the lower level state 
machines 1420-1422 issue respective series of operation codes instructing the 

1 0 computation engine 1405, 1406 to copy the corresponding vertex parameter (position, 
normal, or attribute) for vertex 13 from the vertex memory 1408 (source address) to the 
TCL input vertex memory 1413 (destination address). In addition, the position and 
normal state machines 1420, 1421 instruct the computation engine 1405, 1406 to copy 
the position and normal control points associated with one of the edges 18, 20 

15 intersecting vertex 13 from the HOS computation memory 1410 (source addresses) to 
their respective areas 1448, 1449 of the swappable memory 1418 (destination addresses). 
That is, the position state machine 1420 issues an operation code (e.g., "COPY UPPER" 
or "COPY LOWER") instructing the computation engine 1405, 1406 to copy the position 
control points associated with either edge 20 (control points 12, 13, 25 and 26) or edge 18 

20 (control points 13, 14, 22 and 27)~depending on the direction that the walking state 
machine 1419 desires to traverse the iso-parametric lines 302-310~to one section of the 
position area 1448 of swappable memory 1418. Likewise, the normal state machine 1421 
issues an operation code (e.g., "COPY UPPER" or "COPY LOWER") instructing the 
computation engine 1405, 1406 to copy the normal control points associated with either 

25 edge 20 (control points 12, 13, and 30) or edge 18 (control points 13,14 and 3 1) to one 
section of the normal area 1449 of swappable memory 1418. For the purposes of the 
following discussion, the position and normal state machines 1420, 1421 will be assumed 
to have issued operation codes ("COPY UPPER") instructing the computation engine 
1405, 1406 to copy the position and normal control points associated with edge 20 to one 

30 section of their respective areas 1448, 1449 of swappable memory 1418. 
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The "COPY" codes are passed to the HOS arbiter 1427 by the lower-level state 
machines 1420-1422. The HOS arbiter 1427 provides one code 1431 to the arbitration 
module 1403, which in turn provides the code 1431 to a computation engine 1405, 1406. 
The arbitration process continues until the "COPY" code 143 1 from each lower-level 
5 state machine 1420-1422 has been executed by a computation engine 1405, 1406. Each 
code 143 1 may be provided to the same computation engine 1405, 1406 or the codes 
1431 may be divided among the engines 1405, 1406 based on the loading of the engines 
1405, 1406 under the control of the arbitration module 1403. 

Once a computation engine 1405, 1406 receives a "COPY" code 143 1 , the 
10 computation engine 1405, 1406 accesses the vertex memory 1408 or the HOS 

computation memory 1410, depending on which "COPY" code is being processed, and 
retrieves the vertex parameters (e.g., position, normal or attribute components) or certain 
control points (e.g., for a "COPY UPPER" or "COPY LOWER" code) associated with 
the vertex 13 referenced in the operation code 1431. However, one of ordinary skill in 
1 5 the art will appreciate that a fixed tessellation rale set may be hard-coded into an address 
decoder (not shown) to fix the source and destination addresses of "COPY UPPER" or 
"COPY LOWER" codes based on a single or multi-bit flag, instead of including such 
addresses (e.g., HOS computation memory 1410 and swappable memory 141 8) in the 
codes themselves. 

20 The computation engine 1405, 1406 stores the copied vertex parameters of vertex 

13 in a respective output data flow memory 1411, 1412. The vertex parameters are 
stored in the output data flow memory 1411, 1412 so that they may be properly 
sequenced, if necessary, for storage in the TCL input vertex memory 1413. In the case of 
the "COPY" operation, sequencing is less of an issue and the computation engine 1405, 

25 1406 simply stores the copied vertex parameters directly into the address of the TCL 
input vertex memory 1413 identified in the "COPY" operation code received fi-om the 
arbitration module 1403. The computation engine 1405, 1406 stores the copied control 
points in the appropriate areas 1448, 1449 of the swappable memory 1418. 
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After the "COPY" code or codes from each lower-level state machine 1420-1422 
has been processed as indicated by flags set by each lower-level state machine 1420- 
1422, the walking state machine 1419 sets a flag or issues an operation code instructing 
the lower-level state machines 1420-1422 to determine the components of the next 

5 supplemental vertex. The next supplemental vertex is a vertex residing on one of the 
edges 18, 20 that intersect the first supplemental vertex 13, For the purposes of this 
discussion, it is presumed that generation of new vertices 250-261 will occur along iso- 
parametric lines 302-310 in the direction from edge 20 to edge 18 (i.e., along lines 302- 
3 1 0 in which the "w" barycentric coordinate is constant). Therefore, the next vertex to be 

10 computed is vertex 250 of tessellated primitive 236. However, one of ordinary skill in 
the art will appreciate that the vertices 250-261 may alternatively be generated along iso- 
parametric lines in which either the "u" or the "v" barycentric coordinate is constant, 
thereby resulting in a different order for determining components of the new vertices 
250-261. The operation code issued by the walking state machine 1419 may also provide 

1 5 a destination address for the parameters of the vertex 250. The destination address of all 
vertex parameters is preferably the TCL input vertex memory 1413. As noted above, the 
computation engines 1405, 1406 preferably store output data in respective output data 
flow memories 141 1, 1412 for synchronization pvirposes prior to providing the data to the 
TCL input vertex memory 1413. 

20 Responsive to the flag or operation code issued by the walking state machine 

1419 instructing generation of vertex components for supplemental vertex 250, the lower- 
level state machines 1420-1422 begin issuing a series of operation codes to instruct the 
computation engines 1405, 1406 to compute the position, normal and attribute 
components of vertex 250. To compute the position components of vertex 250, the 

25 position state machine 1420 issues a first double instruction operation code (e.g., 
"COMPUTE X, Y") instructing one computation engine 1405 to compute the x- 
component of the vertex position and the other computation engine 1406 to compute the 
y-component of the vertex position during the same clock cycle. The double instruction 
code preferably includes the destination address (e.g., TCL input vertex memory 1413) 

30 received from the walking state machine 1419 and may include the source address (e.g., 
one section of the position area 1448 of the swappable memory 1418). Altematively, the 



36 



source address may be hard-coded into an address decoder in accordance with a fixed 
tessellation rule set. 

Responsive to receiving the "COMPUTE X, Y" code, the computation engines 
1405, 1406 retrieve the x and y-components of the control points 12, 13, 25, 26 from the 

5 position area 1448 of swappable memory 1418, retrieve appropriate weighting factors 
from the edge lookup table 1415 and perform a vector dot product between the retrieved 
control point components and the weighting factors to compute the x and y-components 
of the position of vertex 250. As discussed above, the retrieval of control point 
components from the position area 1448 of swappable memory 1418 is performed on a 

10 column-by-column basis. Accordingly, the column containing the x-components of the 
control points 12, 13, 25, 26 is used to compute the x-component of vertex 250 and the 
column containing the y-components of the control points 12, 13, 25, 26 is used to 
compute the y-component of vertex 250. The edge table 1415 contains pre-stored 
weighting factors that provide a cubic relation between the control points that relate to a 

15 particular edge 18-20 and the position coordinates of the supplemental vertices located 
along that edge 18-20. The control points that relate to a particular edge 18-20 are the 
control points that were determined based on the positions and normals of the two 
vertices that define the edge 18-20. For example, control points 12, 13, 25, 26 relate to 
edge 20, control points 12, 14, 23, and 24 relate to edge 19, and control points 13, 14, 22, 

20 and 27 relate to edge 1 8. 

As stated above, the Bernstein polynomial for position provides that if given the 
control points Pyk^ such that the sum of i, j, and k equals 3 (i+j+k = 3) and the product of 
i, j, and k is greater than or equal to zero (ijk > 0), a cubic Bezier triangle is defined as 

25 where u + v + w= l,i+j+k=3, and Fyk are vectors corresponding to control points 12- 
14 and 22-28. The Bemstein polynomial can be rewritten in long form as: 

B(u,v,w) = P300 • + Po30 • + Poo3 • + P120 • 3uv^ + P102 • 3uw^ + P012 • 3vw^ + 
P021 • 3v^w + P201 • 3u^w + P210 • 3u\ + Pill • 6uvw 
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where P300 corresponds to vertex 12, P030 corresponds to vertex 14, P003 corresponds to 
vertex 13, Pno corresponds to control point 23, P102 corresponds to control point 26, P012 
corresponds to control point 27, P021 corresponds to control point 22, P201 corresponds to 
control point 25, P210 corresponds to control point 24, and Pi 1 1 corresponds to control 
5 point 28. 

Along edge 1 9, w = 0 and v==l -u, thus the Bernstein polynomial reduces to: 

B(u) - P300 • + Po30 • + P120 • 3uv^ + P210 • 3uV 

= Po3o • (1-u)^ + P120 • 3(l-u)^u + P210 • 3(l-u)u^ + P300 • 
Po30 • Co+ P120 • Ci + P210 • C2 + P300 • C3, 
10 where Co=(l-u)^ Ci= 3(l-uf u, C2=3(l-uy, and C3=u^ 

Similarly, along edge 20, v=0 and w=l-u, thus the Bernstein polynomial reduces to: 

B(u) = P300 • + P003 • (1-u/ + P102 • 3u(l-u)^ + P201 • 3u\l-u) 
- P003 • Co + P102 • Ci + P201 • C2 + P300 • C3U^ 

where Co=(l-^)^ Ci= 3(l-u)\ C2=3(l-u)u^, and Cs^ul 

15 Finally, along edge 18, u=0 and w==l-v, thus the Bernstein polynomial reduces to: 
B(v) = Po3o • + Poo3 • (1-v)^ + P012 • 3v(l-v)^+ P021 • 3v\l-v) 

= Po03 • Co + P012 • Ci + P021 • C2 + P030 • C3, 

where Co=(\-y)\ Ci= 3(l-v)\, C2=-3(l-vy, and C3=vl 

For a given tessellation level, the values of the barycentric coordinates (u,v,w) for 
20 the new vertices of the tessellated primitives 221-236 are within a known set of values. 
For example, for a tessellation level of three, "u," "v," and "w" can be any value from the 
set 0, .25, .5, .75, and 1. When the values of "u," "v," and "w" are 1,0,0; 0,0,1; and 0,1,0, 
respectively, the new vertices correspond to the original vertices 12-14 of the high-order 
primitive 10. Therefore, for a tessellation level of three, three additional vertices must be 
25 generated along each edge 18-20 corresponding to the three remaining values of each 
barycentric coordinate which is not zero or one along the particular edge 18-20. The 
edge table 1415 contains the pre-stored weighting factors (e.g., C0-C3) for the various 
possible known values of one of the barycentric coordinates for various possible 
tessellation levels. For example, for a tessellation level of three, the edge table 1415 
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preferably includes the values of (1-u)^, 3(l-u)V 3(l-u)u^, and u^ for u^O.25, 0.50, and 
0.75, 

The size of the edge table 1415 may be minimized by recognizing that the values 
of (1-u)^ 3(l-u)V 3(l-u)u^, and u^ for u==0.75 is the reciprocal of the values of (1-u)^ 
5 3(l-u)V 3(l-u)u^ and u^ for u-0.25. That is, the values of (1-u)^ 3(l-u)V 3(l-u)u^ and 
u^ for u=0.75 are the same as the values of u^ 3(l-u)u^, 3(l-u)V and (1-u)^ for u=0.25. 
Thus, when the values of (1-u)^ 3(l-u)V 3(l-u)u^, and u^ for u^O.75 are desired, the 
values of (1 -u)^, 3(1 -u)^u, 3(1 -u)u^, and u^ for u=0.25 may be read from the edge table 

3 2 2 3 

1415 in reverse order to obtain the desired values of (1-u) , 3(1 -u) u, 3(1 -u)u , and u for 
1 0 u=0.75. Similar table size reduction benefits may be obtained for all tessellation values 
in which one or more values of "u" (or another barycentric coordinate) equal one minus 
other values of "u". 

The edge table 1415 also contains similar weighting factors for use in determining 
the normal components (e.g., normals 272-274, 276) of the edge vertices (e.g., vertices 
15 250-252, 254). The normal weighting factors are derived by expanding the Bernstein 
polynomial defining a quadratic Bezier triangle as follows: 

where u + v + w= l,i+j+k =2, and Nyk are vectors corresponding to control points 1 2- 
14 and 30-32. The Bernstein polynomial can be rewritten in long form as: 

20 B(u,v,w) = N200 • + N020 • v^ + N002 • w^ + Nuo • 2uv + Nioi • 2uw + Noi 1 • vw 

where N200 corresponds to vertex 12, N020 corresponds to vertex 14, N002 corresponds to 
vertex 13, Ni 10 corresponds to control point 32, Nioi corresponds to control point 30, and 
Noi 1 corresponds to control point 3 1 . 

25 Along edge 19, w = 0 and v=l-u, thus the Bemstein polynomial reduces to: 

B(u) = N200 • + N020 • v^ + Ni 10 • 2uv 
= N020 • (1-u)^ + Nuo • 2(l-u)u + N200 • 
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= No2o • C'o+ Niio • C'l + N200 • C'2, 
where C'o=(l-uf , C'i= 2(1 -u)u, and C\= u^. 

Similarly, along edge 20, v=0 and 'w=l-u, thus the Bernstein polynomial reduces to: 

B(u) = N002 • (1 -u)^ + Nioi • 2(1 -u)u + N200 • 
5 -Noo2*C'o + Nioi«C'i+N2oo'C'2, 

where C'o=(l-u)^ C'i= 2(1 -u)u, and C'2= ul 

Finally, along edge 18, u=0 and w=l-v, thus the Bernstein polynomial reduces to: 

B(v) = N002 • (1-v)^ + Noil • 2(l-v)v + N020 • 
= N002 • Co + Noil • C 1 + N020 • C'2, 
10 where C'o=(l-v)^ C'i= 2(l-v)v, and €'2= 

Therefore, the edge table 1415 also contains pre-stored weighting factors (e.g., 
C'o-C'2) for the various possible values of one of the barycentric coordinates for various 
possible tessellation levels to facilitate determination of the normal components of the 
new vertices along each edge 18-20 of the high-order primitive 10. For example, for a 

15 tessellation level of three, the edge table 1415 preferably includes the values of (1-u) , 
2(l-u)u, and u^ for u-0.25, 0,50, and 0.75. The size of the portion of the edge table 1415 
used to store the normal weighting factors may also be reduced as discussed above with 
respect to the position weighting factors by noting that some of the values of "u" (or 
another barycentric coordinate) are equal to one minus other values of "u". In other 

20 words, some values of "u'' are complements of other values of "u". Thus one set of 

normal weighting factors may be stored for two values of "u". In such a case, the stored 
weighting factors are read from the table 1415 in one direction for one value of "u" and 
are read from the table 1 4 1 5 in the opposite direction for the complement value of "u". 

After the position state machine 1420 has been notified by the arbitration module 
25 1403 that the first double instruction operation code has been executed, the position state 
machine 1420 issues a second double instruction operation code (e.g., "COMPUTE Z, 
W") instructing one computation engine 1405 to compute the z-component of the vertex 
position and the other computation engine 1406 to compute the w-component of the 
vertex position during the same clock cycle. As each of the position coordinates of 
30 vertex 250 is determined, the result is stored in the output data flow memory 1411,1412 
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and then the TCL input vertex memory 1413. For example, during one cycle of the 
computation engines 1405, 1406, the "x" and "y" coordinates are computed. During the 
next processing cycle, the "x" and "y" coordinates are stored in the output data flow 
memories 141 1, 1412 and the "z" and "w" coordinates are computed. During the next 
5 two subsequent cycles, all four coordinates are stored as position components of the new 
vertex 250 in the TCL input vertex memory 1413. 

During the same two clock cycles that the position components of vertex 250 are 
being computed by the computation engines 1405, 1406, the position state machine 1420 
also instructs the computation engines 1405, 1406 (e.g., by issuing a "COPY LOWER" 
operation code) to copy the control points 13, 14, 22, 27 associated with edge 18 into the 
second section of the position area 1448 of swappable memory 1418 to facilitate 
computation of the position components of vertex 251, the next vertex to be computed 
because it lies on the same iso-parametric line 308 as does vertex 250. For example, 
during the first clock cycle (i.e., the clock cycle in which the "x" and "y" coordinates of 
vertex 250 are being computed), each computation engine 1405, 1406 preferably copies 
one control point (e.g., control point 14 and control point 22) relating to edge 18 into the 
second section of the position area 1448 of swappable memory 1418. For instance, 
computation engine 1405 preferably copies one control point (e.g., control point 14) into 
the second section of the position area 1448 of swappable memory 1418 during the same 
clock cycle that it computes the "x" coordinate of vertex 250. Similarly, computation 
engine 1406 preferably copies a different control point (e.g., control point 22) into the 
second section of the position area 1448 of the swappable memory 1418 during the same 
clock cycle that it computes the "y" coordinate of vertex 250. 

During the second clock cycle (i.e., the clock cycle in which the "z" and "w" 
25 coordinates of vertex 250 are being computed), each computation engine 1405, 1406 
preferably copies one of the remaining control points (e.g., control point 27 and control 
point 13) relating to edge 18 into the second section of the position area 1448 of 
swappable memory 1418. For instance, computation engine 1405 preferably copies one 
remaining control point (e.g., control point 27) into the second section of the position 
30 area 1448 of swappable memory 1418 during the same clock cycle that it computes the 
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"z" coordinate of vertex 250. Similarly, computation engine 1406 preferably copies the 
other remaining control point (e.g., control point 14) into the second section of the 
position area 1448 of swappable memory 1418 during the same clock cycle that it 
computes the "w" coordinate of vertex 250. 

5 While the position state machine 1420 is issuing operation codes to instruct the 

computation engines 1405, 1406 to compute the position components of vertex 250, the 
normal and attribute state machines 1421, 1422 are also issuing operation codes to 
instruct the computation engines 1421, 1422 to compute the normal and attribute 
components of vertex 250. The HOS arbiter 1427 receives the operation codes from the 

10 position, normal, and attribute state machines 1420-1422 and selects one operation code 
1431 to provide to the arbitration module 1403 based on a stored prioritization scheme. 
For example, the HOS arbiter 1403 may utilize a back-to-front prioritization scheme as 
discussed above with respect to the arbitration module 1403 to ensure that processing that 
is nearing completion is prioritized over processing that is just beginning or may 

1 5 prioritize position operation codes for processing ahead of normal or attribute operation 
codes. 

The arbitration module 1403 receives the selected operation code 1431 from the 
HOS arbiter 1427 and selects either the HOS operation code 1431 or an operation code 
1433 from another thread to provide to one of the computation engines 1405, 1406. As 

20 discussed above, the arbitration module's operation code selection is preferably based on 
a prioritization scheme, such as the aforementioned passive back-to-front prioritization 
scheme and/or an active prioritization scheme in v^hich a thread controller sets a priority 
bit indicating a priority status of the operation code issued by the controller. For 
example, the v^alking state machine 1419 preferably monitors the contents of the TCL 

25 input vertex memory 1413 by examining the contents of a status register 1429 that 

contains a bitmap indicating a quantity of the vertices currently stored in the TCL input 
vertex memory 1413, When the status register indicates that the TCL input vertex 
memory 1413 is not fiiU or that a quantity of vertices stored in the TCL input vertex 
memory 1413 is less than an implementation-specific threshold (e.g., less than ninety 

30 percent of the maximum number of vertices that can be stored in the TCL input vertex 
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memory 1413), the walking state machine 1419 sets a priority bit associated with the 
issued operation code to indicate that the operation code 1431, once output by the HOS 
arbiter 1427, has priority over operation codes 1433 issued by other thread controllers. 
Thus, the HOS thread controller 1401 actively asserts priority in an attempt to keep the 
5 TCL input vertex memory 1413 full and, thereby, reduce the likelihood that TCL 
processing may have to wait for new vertices from the HOS thread controller 1401 
because TCL processing was allowed to complete before a sufficient number of new 
vertices were provided. 

In a manner similar to the computation of the position components of vertex 250, 
the normal components of vertex 250 are computed by the computation engines 1405, 
1406 imder the control of the normal state machine 1421 . In the preferred embodiment, 
the normal state machine 1421 issues a double instruction operation code during a first 
clock cycle followed by a single instruction code during the next clock cycle to instruct 
the computation engines 1405, 1406 to compute the x, y, and z components of the normal 
vector 272. To compute the x and y-components of normal 272, the normal state 
machine 1421 issues a double instruction operation code (e.g., "COMPUTE X, Y") 
instructing one computation engine 1405 to compute the x-component of the normal 272 
and the other computation engine 1406 to compute the y-component of the normal 272 
during the same clock cycle. The double instruction code preferably includes the 
destination address (e.g., TCL input vertex memory 1413) received from the walking 
state machine 1419 and may include the source address (e.g., one section of the normal 
area 1449 of the swappable memory 1418). Alternatively, the source address may be 
hard-coded into an address decoder in accordance with a fixed tessellation rule set. 

Responsive to receiving the "COMPUTE X,Y" code from the normal state 
25 machine 1421, the computation engines 1405, 1406 retrieve the x and y-components of 
the normal control points 12, 13, 30 from the normal area 1449 of swappable memory 
1418 (which normal control points 12, 13, 30 were stored in the normal area 1449 of the 
swappable memory 1418 during the clock cycle or cycles in which the vertex 
components for vertex 13 were copied from vertex memory 1408 into the output data 
30 flow memory 141 1 , 1412 or the TCL input vertex memory 1413), retrieve appropriate 
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weighting factors (C'o-C'2) from the edge lookup table 1415, and perform a vector dot 
product between the retrieved control point components and the weighting factors to 
compute the x and y-components of normal 272. As discussed above, the retrieval of 
control point components from the normal area 1449 of swappable memory 1418 is 
5 performed on a column-by-column basis. Accordingly, the colunm containing the x- 
components of the control points 12, 13, 30 is used to compute the x-component of 
normal 272 and the column containing the y-components of the control points 12, 13,30 
is used to compute the y-component of normal 272. 

During a subsequent (but not necessarily the next in time) clock cycle as assigned 
10 by the combination of the HOS arbiter 1427 and the arbitration module 1403, the 

computation engine 1405, 1406 selected by the arbitration module 1403 computes the z- 
component of normal 272 by retrieving the z-components of the normal control points 12, 
13, 30 from the normal area 1449 of swappable memory 1418, retrieving the appropriate 
weighting factors (C'o-C'2) from the edge lookup table 1415, and performing a vector dot 
1 5 product between the retrieved control point components and the weighting factors to 
compute the z-component of normal 272. 

During the same two clock cycles that the components of normal 272 are being 
computed by the computation engines 1405, 1406, the normal state machine 1421 also 
instructs the computation engines 1405, 1406 (e.g., by issuing a "COPY LOWER" 
20 operation code) to copy the normal control points 13, 14, 31 associated with edge 18 into 
the second section of the normal area 1449 of swappable memory 1418 to facilitate 
computation of the normal components of normal 273, the next normal to be computed 
because it relates to vertex 251, which lies on the same iso-parametric line 308 as does 
vertex 250. 

25 Although the above discussion has suggested that the positions of original vertices 

12-14 are stored in the position and normal areas 1448, 1449 of the swappable memory 
1418 when one or more of such vertices 12-14 form control points for computing a 
particular new vertex 250-261, one of ordinary skill in the art will appreciate that such 
vertices 12-14 are already stored in vertex memory 1408 and, therefore, need not be 
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restored in the swappable memory areas 1448, 1449. Rather, the respective addresses of 
the components of the original vertices 12-14 that are necessary for a particular new 
vertex computation may be included as source addresses for any operation codes that 
require use of such original vertex information. 

5 During the time period that the position and normal state machines 1420, 1421 are 

issuing operation codes for computing the position and normal components of vertex 250, 
attribute state machine 1422 is also issuing operation codes to compute any other 
attributes (e.g., texture coordinates, fog data, color data, and/or blend weights) of the 
vertex 250. In a preferred embodiment, these additional attributes are linearly 
10 interpolated based on corresponding attributes of the original vertices 12-14 of the high- 
order primitive 10. Consequently, each additional attribute of vertex 250 is derived as a 
selected linear combination of the corresponding attributes of vertices 12-14. Therefore, 
tf^ the attribute state machine 1422 issues operation codes (e.g., COMPUTE codes) 

m instructing the selected computation engine 1405, 1406 to perform a set of vector dot 

1 5 products between the components of the attributes and predetermined weighting factors 
0 to derive each attribute. The weighting factors to be applied to the applicable attributes 

S of the original vertices 12-14 may be stored in another database or lookup table (not 

!^ shown) of the high-order primitive processing unit 460. Similar to the position and 

H= normal areas 1448, 1449 of swappable memory 1418, the attribute area 1450 of 

S 20 swappable memory 141 8 is also preferably double-buffered. Accordingly, while one 
— attribute of vertex 250 (or any other new vertex 250-261) is being computed by applying 

linear barycentric interpolation to corresponding attributes of the original vertices 12-14, 
another attribute of each original vertex 12-14 is preferably stored in the attribute area 
1450 of swappable memory 141 8 for use in computing the next attribute of the new 
25 vertex 250, The completed attributes are stored in the TCL input vertex memory 1413. 
Similar to the computations required for determining the position and normal components 
of vertex 250, all intermediate computation results involved in determining the other 
attributes of vertex 250 are stored temporarily in the HOS computation memory 1410. 

Once the computation engines 1405, 1406 have computed the position, normal 
30 and attribute components for vertex 250, they begin issuing instructions (e.g., 
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"COMPUTE LOWER" instructions) to compute the respective components of vertex 25 1 
in a maimer similar to the above-described computations for vertex 250, except that 
newly loaded position control points 13, 14, 22, 27 and normal control points 13, 14, 31 
are used for the computations of the position components and normal components, 
5 respectively, of vertex 251 . During the same clock cycles in which the position and 

normal components of vertex 251 are being computed, the position control points 12, 13, 
25, 26 and the normal control points 12, 13, 30 associated with edge 20 are stored in 
respective sections of the position and normal areas 1448, 1449 of swappable memory 
1418 to facilitate the determination of the position and normal components, respectively, 
1 0 of vertex 252. That is, in addition to issuing "COMPUTE" operation codes to determine 
the position and normal components of vertex 251, the position and normal state 
machines 1420, 1421 also issue "COPY" operation codes ("COPY UPPER" in this case) 
y to copy the respective position and normal control points from HOS computation 

ffl memory 1410 into the appropriate areas 1448, 1449 of swappable memory 1418. As 

S j 15 discussed above, each area 1448-1450 of the swappable memory 1418 is preferably 
W double-buffered to enable the computation engines 1405, 1406 to read control points 

m (e.g., control points 13, 14, 22, 27 and 31) necessary to compute the components of one 

L vertex (e.g., vertex 251) from one section of each area 1448-1450 at the same time that 

HI the computation engines 1405, 1406 are storing control points (e.g., control points 12, 13, 

Q 20 25, 26 and 30) necessary to compute the components of another vertex (e.g., vertex 252) 
^ in another section of each area 1448-1450, 

Although the position and normal control points related to the upper edge 20 of 
the high-order primitive 10 are, in accordance with a preferred embodiment of the present 
invention, generally loaded or copied into respective areas 1448, 1449 of swappable 

25 memory 1418 during the clock cycle or cycles in which parameters for a vertex located 
along the lower edge 18 of the high-order primitive 10 are being computed, one of 
ordinary skill in the art will recognize that such re-loading or re-copying of control points 
need not occur during the computation of vertex parameters for vertex 25 1 . That is, since 
the vertex 250 computed just before vertex 251 also lies along the upper edge 20, the 

30 position and normal control points 12, 13, 25, 26, 30 for the upper edge 20 are already 
stored in one section of the position and normal areas 1448, 1449 of swappable memory 



1418. Therefore, processing resources need not be used to re-copy those same control 
points 12, 13, 25, 26, 30 into the same sections of the position and normal areas 1448, 
1449 of swappable memory 1418. Rather, the control points 12, 13, 25, 26, 30 may just 
be read from the position and normal areas 1448, 1449 as necessary to compute the 
5 position and normal components of the upper edge vertex 252. 

Once the components of vertex 251 have been computed, the walking state 
machine 1419 determines that a tessellated primitive 236 has been completed and issues 
operation codes that instruct the TCL input vertex memory 1413, via the HOS arbiter 
1427, the arbitration module 1403, and a selected computation engine 1405, 1406, to 

1 0 output the vertices 13, 250, 25 1 for the completed primitive 236 to the next processing 
stage (e.g., transformation, clipping, lighting, etc.) and to delete the vertex information 
for vertex 13. Hov^ever, the vertex information for vertices 251 and 252 remains in TCL 
input vertex memory 1413 because such vertices 251, 252 help define other uncompleted 
tessellated primitives 229, 234, 235. Thus, in accordance with the present invention, 

15 computed vertices remain stored in TCL input vertex memory 1413 until they are no 
longer needed to form a tessellated primitive. Consequently, vertex components are 
computed only once for each new vertex 250-261 and are used (and reused) to define 
respective tessellated primitives. By computing vertex components for each new vertex 
250-261 only once, substantial processing savings result as compared to repeatedly 

20 computing vertex information for each vertex of each tessellated primitive. Since the 
new vertices 250-261 are computed along iso-parametric lines 302-310, vertex 
information for each new vertex 250-261 can be stored for a sufjficient period of time in 
TCL input vertex memory 1413 to enable completion of the tessellated primitives defined 
by each vertex without completely filling or overflowing the TCL input vertex memory 

25 1413 (which, in a preferred embodiment, can store information for up to ten vertices). 

The position, normal, and attribute components of vertex 252 are computed in a 
manner similar to the computations of the corresponding components of vertex 250. 
However, in contrast to the operations related to vertex 250, the control points 13, 14, 22, 
27, 31 related to edge 18 are not stored in the position and normal areas 1448, 1449 of 
30 swappable memory 1418 during computation of the position and normal components of 
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vertex 252. Rather, predetermined combinations of the position and normal control 
points 22-28j 30-32 are copied from the HOS computation memory 1410 into respective 
areas 1448, 1449 of the sv^appable memory 1418 for use in determining nev^ control 
points 248, 249, 263, 265, 266. For example, the combination 3Pi2o-3Po3o in equation Q2 
5 below related to position control points 252, 248, 249, and 263 is copied from the HOS 
computation memory 1410 into the position area 1448 of swappable memory 1418 for 
use in determining control point 248. Similarly, the combination 2Nioi-2Niio in equation 
Q2" below related to normal control points 252, 265, and 266 is copied from the HOS 
computation memory 1410 into the normal area 1449 of swappable memory 1418 for use 
10 in determining control point 265. The control point combinations are preferably stored in 
the HOS computation memory 1410 during computation of the position and normal 
control points 22-28, 30-32. 

Altematively, all the position control points 22-28 and normal control points 30- 
32 related to the high-order primitive 10 may be copied into respective areas 1448, 1449 

1 5 of swappable memory 141 8 for use in determining the new control points 248, 249, 263, 
265, 266 to be used in determining vertex components for vertex 253. For example, 
control points 22-28 may be copied into the position area 1448 of swappable memory 
1418 during the two clock cycles in which the x, y, z, and w-components of vertex 252 
are computed by the computation engines 1405, 1406. Similarly, control points 30-32 

20 may be copied into the normal area 1449 of swappable memory 1418 during the two 
clock cycles in which the x, y, and z-components of normal 274 are computed by the 
computation engines 1405, 1406. Storage of all the position and normal control points 
22-28, 30-32 in their respective areas 1448, 1440 of swappable memory 1418 increases 
the memory requirements of the swappable memory 1418 and may require repeated 

25 computation of various control point combinations. Consequently, storage of all the 
position and normal control points 22-28, 30-32 in their respective areas 1448, 1440 of 
swappable memory 1418 is less preferable than storing only the predetermined control 
point combinations as discussed above. 

After all the vertex parameters for vertex 252 have been computed and stored in 
30 the TCL input vertex memory 1413, the walking state machine 1419 instructs the position 
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and normal state machines 1420, 1421 to compute respective supplemental control points 
relating to iso-parametric line 306. The position supplemental control points relating to 
iso-parametric line 306 preferably consist of vertex 252 and three additional control 
points 248, 249, and 263 as depicted in FIG. 9. The additional position control points 
248, 249, and 263 are preferably determined by performing a dot product of a 
combination of the original control points 12-14, 22-28 with predetermined coefficients 
stored in the ISO_C lookup table 1416. Thus, the locations of the supplemental position 
control points 252, 248, 249, 263 may be determined by evaluating the Bernstein 
polynomial defining a cubic Bezier triangle for a constant value of the "w" barycentric 
coordinate and substituting v=l-w-u: 

tl jlkl 

where 

Q2=0Pm -3Po3o)(l->^)' +(6^^111 -6Po2iMl->i^) + (3^o2 -3Pon)>^'; 
Qs = (3^^210 " + 3Po3o)(l - + (3^^021 + 3P201 - 6Pn,)w; and 

Qa ~ P3OQ ~ 3^210 3-^20 ~ ^30' 

In the above equations, P300 corresponds to vertex 12, P030 corresponds to vertex 
14, P003 corresponds to vertex 13, P120 corresponds to control point 23, P102 corresponds to 
control point 26, P012 corresponds to control point 27, P021 corresponds to control point 
22, Pioi corresponds to control point 25, P210 corresponds to control point 24, and Pm 
corresponds to control point 28. Each of the above equation results (i.e., Q1-Q4) define 
the positions of the supplemental position control points along a particular iso-parametric 
line and have respective x, y, z, and w-components which are stored in the position area 
1448 of swappable memory 1418. For example, when the iso-parametric line is line 306, 
the value of the "w" barycentric coordinate is 0.5 and the four supplemental control 
points correspond to control points 252, 248, 249 and 263. For line 306, equation Qi 
defines vertex/control point 252, equation Q2 defines control point 248, equation Q3 
defines control point 249, and equation Q4 defines control point 263. The coefficients 
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stored in the ISO__C table 1416 may be given by the following formulas for the iso- 
parametric lines for which the "w" barycentric coordinate is constant: 

(1-w)^, w(l-w)^ (l-w)w^, (1-wX (l-w)w, w, w^, and w^. 

The results of the above formulas (i.e., coefficients) for various values of "w" are stored 
5 as entries in the ISO_C lookup table 1416 for a predetermined number of tessellation 
levels to facilitate the determination of the supplemental control points, which in turn are 
used in determining the supplemental vertices along iso-parametric lines. 

The supplemental position control points 252, 248, 249, 263 are computed as dot 
products between various combinations and scaled values of the original position control 
10 position points 12-14, 22-28 and the coefficients stored in the ISO_C table 1416. For 
Q example, supplemental control point 248 is preferably computed by the following dot 

product to produce the x, y, and z-coordinates of the control point 248 : 

m CP248 = [(3Pi2o-3Po3o) (6Piii-6Po2i) (3Pio2-2Poi2)] • [(1-w)^ w(l-w) w^] 

^ The coordinates of the remaining additional control points 249, 263 are computed in a 

^ 15 similar manner. The position coordinates of vertex 252 are preferably copied to both 
IJ1 TCL input vertex memory 1413 and the position area 1448 of sv^appable memory 1418 

ilj after being computed by the computation engines 1405, 1406. 

1=^ As the additional control points 248, 249, 263 are computed, they are stored in the 

position area 1448 of swappable memory 1418 together with control point 252. The 

20 supplemental control points 252, 248, 249, 263 are then used to compute position 

components of the vertices (in the case of iso-parametric line 306, a single vertex 253) 
within the boundary of the high-order primitive 10 that are located along the particular 
iso-parametric line 306. To compute vertex 253 (or any other vertex within the boundary 
of the high-order primitive 10 that is located along an iso-parametric line 306), the 

25 Bernstein polynomial defining a cubic Bezier triangle is evaluated at the supplemental 
control points 252, 248, 249, 263 . Thus, in a manner similar to the computation of the 
vertices 250, 252, 255 along edge 20, the computation engine 1405, 1406 performs a dot 
product of the supplemental control points 252, 248, 249, 263 with particular weighting 
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factors stored in the ISO lookup table 1417. The weighting factors stored in the ISO 
lookup table 1417 provide a cubic relation between the supplemental control points (e.g., 
control points 252, 248, 249 and 263) and the position coordinates of the supplemental 
vertices (e.g., vertex 253) located along lines in which one barycentric coordinate is 
constant (i.e., along iso-parametric hues). The weighting factors stored in the ISO table 
1417 are the weights applied to the supplemental control points 252, 248, 249, 263 in the 
expanded Bernstein polynomial, and are stored based on tessellation level. That is, with 
respect to the equation B(u) = Qiu^+Q2U^+Q3U^+Q4U^ provided above, the ISO table 1417 
stores the values of u\ u^, and u^ for particular tessellation levels. One of ordinary skill 
in the art will appreciate that the value of u^ is always one and, therefore, need not be 
stored in the ISO table 1417. 

The normal supplemental control points relating to iso-parametric line 306 
preferably consist of vertex 252 and two additional control points 265 and 266 as 
depicted in FIG. 9. The additional normal control points 265 and 266 are preferably 
determined by performing a dot product of a combination of the original normal control 
points 12-14, 30-32 with predetermined coefficients stored in the ISO_C lookup table 
1416. Thus, the locations of the supplemental normal control points 252, 265, 266 may 
be determined by evaluating the Bernstein polynomial defining a quadratic Bezier 
triangle for a constant value of the "w" barycentric coordinate and substituting v=l-w-u: 

^(^) - H^f^y^^'^'^' = Qi + Q> + Qy 

where 

a" = A^o2o(l - + 2N,,,w(L -w) + N,,y; 
^3 =7Vo2o-2A^on+^oo2. 

In the above equations, N020 corresponds to vertex 14, N002 corresponds to vertex 
13, Niio corresponds to control point 32, Nioi corresponds to control point 30, and Non 
corresponds to control point 31. Each of the above equation results (i.e., Q^'i-Q^'s) define 
the positions of the supplemental normal control points along a particular iso-parametric 
line and have respective x, y, and z-components which are stored in the normal area 1449 
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of swappable memory 1418. For example, when the iso-parametric line is line 306, the 
value of the "w" barycentric coordinate is 0.5 and the three supplemental normal control 
points correspond to control points 252, 265 and 266. For line 306, equation Q"i defines 
vertex/control point 252, equation Q"2 defines control point 265, and equation Q^a defines 
control point 266. The coefficients stored in the ISO_C table 1416 may be given by the 
following formulas for the iso-parametric lines for which the "w" barycentric coordinate 
is constant: 

(1-w)^ (l-w)w, (1-w), w, and w^. 

The values of the results of the above formulas for various values of "w" are stored as 
entries in the ISO_C lookup table 1416 for a predetermined number of tessellation levels. 

The supplemental normal control points 252, 265, 266 are computed as dot 
products between various combinations and scaled values of the original normal control 
position points 12-14, 30-32 and corresponding coefficients stored in the ISO^C lookup 
table 1416. For example, supplemental control point 265 is preferably computed by the 
following dot product to produce the x, y, and z-coordinates of the control point 265: 

CP265 = [(2Nioi-2Nuo) (2Noii-2No2o)] • [w (1-w)] 

The coordinates of the remaining additional normal control point 266 are 
computed in a similar manner. The position coordinates of vertex 252 are preferably 
copied to both TCL input vertex memory 1413 and the normal area 1449 of swappable 
memory 1418 after being computed by the computation engines 1405, 1406. 

As additional normal control points 265 and 266 are computed, they are stored in 
the normal area 1449 of swappable memory 1418 together with control point 252. The 
supplemental control points 252, 265, 266 are then used to compute normal components 
of the vertices (in the case of iso-parametric line 306, a single vertex 253) within the 
boundary of the high-order primitive 10 that are located along the particular iso- 
parametric Une 306. To compute normal 275 (or any other normal for a vertex within the 
boundary of the high-order primitive 10 that is located along an iso-parametric line 306), 
the Bernstein polynomial defining a quadratic Bezier triangle is evaluated at the 
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supplemental control points 252, 265, 266. Thus, in a manner similar to the computation 
of the normal components of the vertices 250, 252, 255 along edge 20, the computation 
engine 1405, 1406 performs a dot product of the supplemental normal control points 252, 
265, 266 with particular weighting factors stored in the ISO lookup table 1417. The 
5 weighting factors stored in the ISO lookup table 1417 provide a quadratic relation 

between the supplemental control points (e.g., control points 252, 265 and 266) and the 
normal components (e.g., normal 275) of the supplemental vertices (e.g., vertex 253) 
located along lines in which one barycentric coordinate is constant (i.e., along iso- 
parametric lines). The weighting factors stored in the ISO table 1417 are the weights 
10 applied to the supplemental control points 252, 265, 266 in the expanded Bemstein 
polynomial, and are stored based on tessellation level. That is, with respect to the 
equation B(u) = QiU*^+Q2U^+Q3U^ provided above, the ISO table 1417 stores the values of 
u^ and u^ for particular tessellation levels. As noted above, u*^ is always one and need not 
be stored. 

15 Similar to the computation of the position, normal and attribute components of the 

edge vertices 250-252, the lower level state machines 1420-1422 issue respective series 
of operation codes, including double and/or single instruction codes, instructing the 
computation engines 1405, 1406 to compute the position, normal and attribute 
components of the interior vertices 253 along the particular iso-parametric line 306 

20 currently being evaluated. The order in which the issued operation codes are executed is 
controlled by the HOS arbiter 1427 and the arbitration module 1403 as described above. 
The position and normal state machines 1420, 1421 may also issue operation codes 
instructing the computation engines 1405, 1406 to copy the control points associated with 
an edge into respective areas 1448, 1449 of swappable memory 1418 if the next vertex to 

25 be computed is along the edge. For example, in addition to issuing operation codes for 
computing the position components of vertex 253, the position state machine 1420 also 
issues operation codes for copying the control points 13, 14, 22, 27 related to edge 18 to 
the position area 1448 of swappable memory 1418 because the next vertex to be 
computed is vertex 254, which lies along both iso-parametric line 306 and edge 18. 



53 



If, however, the next vertex to be computed lies along the current iso-parametric 
and within the boundary of the high-order primitive 10 (e.g., if vertex 256 is being 
computed along iso-parametric line 304 and the next vertex to be computed is vertex 257 
also along iso-parametric line 304 ), nothing additional need be copied into swappable 
memory 1418 because the position and normal control points for the next vertex have 
already been computed and stored in their appropriate locations in swappable memory 

1418 in preparation for computing the position and normal components of the vertex 
being computed presently. For example, if the components of vertex 256 are presently 
being computed, nothing additional need be stored in swappable memory 1418 to 
facilitate the computation of the components of vertex 257. 

Since, in this example, the next vertex to be computed is vertex 254, the position 
and normal control points 13, 14, 22, 27, 31 are copied into respective areas 1448, 1449 
of swappable memory 1418 during the computation cycle or cycles in which the 
components of vertex 253 are computed. After the vertex components of vertex 253 have 
been computed and stored in TCL input vertex memory 1413, the walking state machine 

1419 instructs the TCL input vertex memory 1413 to output primitives 229 and 235, and 
de-allocate or delete vertex 250 from TCL input vertex memory 1413. Thus, in 
accordance with the reuse methodology of the present invention, computed vertices 
remain in TCL input vertex memory 1413 until they are no longer needed to construct a 
tessellated primitive. Once a vertex is no longer needed to construct a tessellated 
primitive, the walking state machine 1419 instructs the TCL input vertex memory 1413 to 
de-allocate or delete the unneeded vertex to make room for additional vertices and, 
thereby, facilitate use of a TCL input vertex memory 1413 without extraordinary memory 
requirements. 

The remaining vertices 254-259 of the tessellated primitives 221-236 are 
computed in order along iso-parametric lines starting at one edge 20, traversing the iso- 
parametric line to the other edge 18 and then returning to the starting edge 20 to repeat 
the process. As discussed above, control points, if any, that may be necessary to faciUtate 
a subsequent computation are copied into appropriate areas of swappable memory 1418 
during the computation cycle or cycles used to compute the components of a current 
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vertex. In addition, computed vertices remain stored in the TCL input vertex memory 
1413 until they are no longer needed to construct a yet-to-be-outputted tessellated 
primitive, at which time they are de-allocated from the TCL input vertex memory 1413. 
One of ordinary skill will recognize that when the vertex being computed is vertex 12 (in 
5 which case the components of vertex 12 are copied into TCL input vertex memory 1413), 
the control points 12, 14, 23, 24 related to edge 19 are copied into swappable memory 
1418, instead of supplemental control points being generated, because all the new 
vertices 259-261 that lie along iso-parametric line 302 also lie along edge 19. 

Although the general operation of the high-order primitive processing unit 460 to 
1 0 perform the functions of the control point generation block 420 and the tessellation block 
430 has been described above, such operation may be varied in accordance with the 
present invention to significantly reduce the quantity of computations for low-level 
tessellation. As discussed above, for a tessellation level of one, only one additional 
vertex 131-133 is computed along each edge 18-20 as illustrated in FIG. 1 1. In addition, 
15 as discussed above, the position, normal and attribute components of the additional 

vertices 131-133 can be computed directly from the components of original vertices 12- 
14 of the high-order primitive 10 without resort to the generation and use of control 
points. For example, the position and normal components of vertices 131-133 may be 
computed directly from the position and normal components of the original vertices 12- 
20 14 from the following equations: 

for position: 

Vi31 - /2(Vi3+Vi2) + y8[(E20^Ni3)Ni3 - (E20*Ni2)Ni2], 

Vi32 = /2(Vi4+Vi3) + /8[(Ei8-Ni4)Ni4 - (Ei8*Ni3)Ni3], and 

Vi33 = ^/2(Vi2+Vi4) + H[(Ei9-Ni2)Ni2- (Ei9*Ni4)Ni4], 

25 for normal: 

Ni3l = /2 (Ni3 +N14) - %[Ei8-Ni3 + Ei8-Ni4][Ei8/|Ei8p], 

Ni32 = /2 (N12 +N13) - y8[E2o'Ni2 + E2o*Ni3][E2o/|E2oP], and 
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Ni33 = V2 (Ni2 +N14) - H[Ei9-Ni2 + Ei9^Ni4][Ei9/|Ei9ft, 



where Eig = V13-V14, E19 = V12-V14, and E20 = V13-V12. 

Thus, the position and normal components of vertices 131-133 may be computed 
by the computation engines 1405, 1406 responsive to operation codes issued respectively 
5 by the position and normal state machines 1420, 1421 instructing the computation 

engines 1405, 1406 to perform the respective scalar and vector operations required by the 
above equations. For example, to compute the positions of vertices 131-133, the position 
state machine 1420 issues a respective series of operation codes to compute the equations 
for V131-V133. Each series of operation codes effectively instruct the computation engines 
10 1405, 1406 to compute one-eighth of the scaled difference between projections of an 
edge defined by any two consecutive vertices onto the normal vectors of the two 
consecutive vertices in a clockwise direction summed with an average of the position 
coordinates of the two consecutive vertices to determine the position coordinates of the 
supplemental vertex located along the edge. 

1 5 All the intermediate computations required by the above equations are preferably 

stored in the HOS computation memory 1410 as described above. The final position or 
normal result is then copied by the selected computation engine 1405, 1406 into the 
register of the TCL input vertex memory 1413 associated with the vertex 131-133 being 
computed responsive to a "COPY" instruction code issued by the appropriate state 

20 machine 1420, 1421 . By performing direct computation of new vertex components for 
low level tessellation (e.g., for tessellation levels of one or two), the present invention 
substantially reduces the amount of processing time and resources necessary to compute 
the vertex components as compared to first computing control points and then computing 
vertex components. 

25 By performing high-order primitive tessellation in hardware as described above, 

the present invention facilitates more rapid processing of high-order graphics primitives 
as compared to the prior art. In contrast to the prior art, which employs the application 
host processor to perform tessellation in software, the present invention preferably uses a 
unique hardware implementation premised on the generation of control points to expedite 
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computation of vertex parameters for the tessellated primitives, and vertex parameter 
reusability resulting from generation of vertices along iso-parametric lines to reduce 
memory requirements and reduce the amount of redundant transform, clipping, and 
lighting (TCL) processing performed on the newly generated vertices. By performing 
5 tessellation in hardware, the application running on the central processor can issue 
drawing commands for large non-planar primitives that identify respective desired 
tessellation levels and can rely on the hardware to efficiently perform the necessary 
tessellation, thereby reducing the bandwidth requirements for communicating primitive 
vertex information from the application to the graphics processing hardware when 
1 0 tessellation is required. 

In addition, the present invention preferably utilizes various degrees of 
interpolation to derive the vertex parameters for the vertices of the tessellated primitives, 
in sharp contrast to prior art tessellation techniques that only use linear interpolation to 
compute all the vertex parameters. For example, the present invention preferably utilizes 

15 cubic interpolation to generate the position components of the vertices, quadratic 
interpolation to generate the normals of the vertices (which, as is known, are used to 
perform lighting processing on the vertices), and linear interpolation for the remaining 
vertex attributes. Such use of various degrees of interpolation to determine vertex 
components of tessellated primitives improves the quality of displayed images that 

20 include high-order primitives, while balancing the computational costs for obtaining such 
improved image quality. 

FIG. 15 illustrates a block diagram of a preferred computation engine 1405, 1406 
and output data flow memory 141 1, 1412 for use in the high-order primitive processing 
unit 460 of FIG. 14. The computation engine 1405, 1406 includes a vector engine 1501, 

25 a scalar engine 1503, a state controller 1505, the arbitration module 14, and a plurality of 
data flow memory devices 1508-1515. Li general, the vector engine 1501 processes 
vector information for the attributes of a given vertex of a primitive. The vector engine 
1501 is designed to perform particular types of mathematical operations in an efficient 
manner. Such mathematical operations include vector dot products operations, vector 

30 addition operations, vector subtraction operations, vector multiply and accumulate 
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operations, and vector multiplication operations. The vector dot products (Vq • Vi) 
generally performed by the vector engine 1501 correspond to (xo • xi) + (yo • yi) + (zo • zi) 
+ (v^o * wi), where xq, yo, zo, and wo may be the x-coordinates for vector Vo (e.g., the 
vector control point x-coordinates) and xi, yi, zi, and wi may be coordinates for vector 
Vi (e.g., the vector of weighting factors in the edge table 1415). 

The scalar engine 1503 may be generally dedicated to performing lighting effect 
functions. The scalar engine 1503 is capable of performing a variety of scalar operations 
such as inverse functions, x^ functions, e"" functions, 1/x functions, and the inverse of the 
square root of x functions. The 1/x function may be used for determining a range for 
lighting effects, the x^ function may be used for specular lighting effects, the e"" function 
may be used for fogging effects, and the inverse of the square root of x may be used in 
normalized vector calculations. Li addition, the scalar engine 1503 may support state 
functions as defined in the OpenGL specification. 

The vector engine 1501 produces results based on the ordered operation codes 
received firom the arbitration module 1403. The results produced may be stored in the 
intermediate data flow memory 1510 (e.g., the HOS computation memory 1410), a vector 
engine (VE) output flow data memory 1514 of the overall output data flow memory 
1411, 1412 or a vector engine-scalar engine (VESE) data flow memory 1511. The VESE 
data flow memory 1511 represents an inter-engine data path that allows the resuhs of the 
vector engine 1501 to be provided to the scalar engine 1503. The communication of 
resuhs to the intermediate data flow memory 1510 and the output data flow memory 
1411, 1412 were discussed above with reference to FIG. 14, If the result is stored in the 
VESE data flow memory 1 5 1 1 , the data may be used in subsequent processing by the 
scalar engine 1503, such as that involving the calculation of lighting effects. 

The state controller 1505 receives state information 1506 from the application 
originating the drawing coromands and either stores it in the state vector engine (VE) data 
flow memory 1508 or the state scalar engine (SE) data flow memory 1509. The state 
information 1506 indicates the particular mode of operation within which the vector and 
scalar engines 1501 and 1503 are executing. The state information 1506 may be state 
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information that defines specific operational modes compliant with those described in the 
OpenGL specification. 

The scalar engine 1503 produces results that are stored in at least one of a scalar 
engine- vector engine (SEVE) data flow memory 1513, a scalar engine intermediate data 
flow memory 1512 (e.g., the HOS computation memory 1410), and a scalar engine (SE) 
output data flow memory 1515. The scalar engine intermediate data flow memory 1512 
stores results produced by the scalar engine 1503 that are used in subsequent operations 
by the scalar engine 1503. The SEVE data flow memory 1513 represents an inter-engine 
data path that allows the results of the scalar engine 1513 to be provided to the vector 
engine 1501 . The data carried along inter-engine data paths (whether vector engine-to- 
scalar engine or scalar engine-to-vector engine) may be referred to as inter-engine data. 

The particular destination for a result of the scalar engine 1503 is based on the 
operation code being executed. The arbitration module 1403 preferably generates 
ordered operation codes for the scalar engine 1503. Each operation code provided to the 
scalar engine 1503 preferably includes a corresponding destination address for the resuh 
that is generated through execution of the code. By having dedicated memories in each 
data flow path (as shown in FIG. 1 5), memory contention is eliminated. During each 
cycle, each memory 1508-1515 is only expected to provide one operand to one operation 
unit in the system. In one embodiment, each memory 1508-1515 includes a read port and 
a write port, where a read operation and a write operation can occur for the memory 
during a cycle. In another embodiment, some memory (e.g., HOS computation memory 
1410) may include two read ports and one write port, where two read operations and a 
write operation can occur for the memory during a cycle. An output controller 1520 is 
also included in the output data flow memory 141 1 , 1412 to control the flow of data from 
the VE and SE output data flow memories 1 5 1 4, 1 5 1 5 to the TCL input vertex memory 
1413 (when additional processing is still necessary) or the frame buffer 450 (when all 
vertex processing is complete). When the computation engine 1405, 1406 is used as a 
geometric engine for graphics processing, the computation engine 1405, 1406 is 
performing specific, well-understood functions such that the various state variables, 
intermediate data storage locations, and the like may be known in advance. By 
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performing such specific functions, memory locations available in the various memories 
1508-1515 may be dedicated to particular portions of one or more operations, thus 
eliminating memory contention issues. 

One of ordinary skill in the art will recognize that a number of optimizations, such 
5 as pre-accumulation registering, per-thread accumulation buffering, shared microcode 
amongst a plurality of threads, and memory bypass registers, can be included in the 
vector engine 1501 and scalar engine 1503 illustrated in FIG. 15 to allov^ the 
functionality of the computation engine 1405, 1406 to be further exploited to gain added 
efficiency. Each of these optimizations may be used alone or in combination with one 
1 0 another to increase processing efficiency. 

The present invention provides a means for determining Bezier control meshes 
that can be used to allow for tessellation of high-order video graphics primitives in 
hardware. The present invention allows the central processor in a computing system to 
offload the tessellation to dedicated hardware such that processing resources within the 

1 5 central processor are available for performing other tasks. As a result, the overall 
computing system may operate more efficiently. Use of the barycentric coordinate 
system in evaluating the Bernstein polynomials or other algorithms simplifies the 
calculations required to obtain the component data for the vertices of the tessellated 
primitives resulting fi-om tessellation. Simplification of these calculations enables such 

20 tessellation to be performed using a limited amount of hardware, thus making a hardware 
implementation of tessellation circuitry feasible as describe herein. 

In the foregoing specification, the present invention has been described with 
reference to specific embodiments. However, one of ordinary skill in the art will 
appreciate that various modifications and changes may be made without departing from 
25 the spirit and scope of the present invention as set forth in the appended claims. 

Accordingly, the specification and drawings are to be regarded in an illustrative rather 
than a restrictive sense, and all such modifications are intended to be included within the 
scope of the present invention. 
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Benefits, other advantages, and solutions to problems have been described above 
with regard to specific embodiments of the present invention. However, the benefits, 
advantages, solutions to problems, and any element(s) that may cause or result in such 
benefits, advantages, or solutions, or cause such benefits, advantages, or solutions to 
become more pronounced are not to be construed as a critical, required, or essential 
feature or element of any or all the claims. As used herein and in the appended claims, 
the term "comprises," "comprising," or any other variation thereof is intended to refer to 
a non-exclusive inclusion, such that a process, method, article of manufacture, or 
apparatus that comprises a list of elements does not include only those elements in the 
list, but may include other elements not expressly listed or inherent to such process, 
method, article of manufacture, or apparatus. 
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